2012-08-08 12:25:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:25:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:25:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:25:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:25:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:25:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 12:25:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 12:25:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 12:25:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2012-08-08 12:25:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:25:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 12:25:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 12:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:25:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:25:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 12:25:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-08 12:25:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:25:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 12:25:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 12:25:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 12:25:03 [DEBUG   ] Finished updating board flags in 1.331 seconds
2012-08-08 12:25:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 12:25:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 12:25:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 12:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:26:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 12:26:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 12:26:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:26:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 12:26:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-08 12:26:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 12:26:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 12:26:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 12:26:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 12:26:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 12:26:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-08 12:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:26:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-08 12:26:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:26:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:26:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 12:26:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 12:26:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 12:26:03 [DEBUG   ] Finished updating board flags in 1.309 seconds
2012-08-08 12:26:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 12:26:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 12:26:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 12:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:27:02 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 12:27:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 12:27:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 12:27:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-08 12:27:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 12:27:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 12:27:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 12:27:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 12:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:27:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:27:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 12:27:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 12:27:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 3
2012-08-08 12:27:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:27:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 12:27:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 12:27:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 12:27:03 [DEBUG   ] Finished updating board flags in 1.340 seconds
2012-08-08 12:27:17 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2012-08-08 12:27:38 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-08 12:27:58 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-08 12:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:28:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 12:28:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 12:28:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 12:28:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 12:28:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:28:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 12:28:02 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 12:28:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-08 12:28:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 12:28:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 12:28:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 12:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:28:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:28:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 12:28:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:28:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 12:28:03 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 12:28:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 12:28:03 [DEBUG   ] Finished updating board flags in 1.540 seconds
2012-08-08 12:28:08 [DEBUG   ] Got command RPT from MCS: ref #5395
2012-08-08 12:28:08 [DEBUG   ] summary = ERROR
2012-08-08 12:28:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5395  13 56147 44888373 A  ERRORERROR'
2012-08-08 12:28:08 [DEBUG   ] Got command RPT from MCS: ref #5396
2012-08-08 12:28:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 12:28:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5396  77 56147 44888373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 12:28:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 12:28:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 12:28:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 12:29:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:29:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:29:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:29:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:29:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:29:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 12:29:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 12:29:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 12:29:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:29:02 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 12:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:29:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2012-08-08 12:29:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:29:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-08 12:29:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:29:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 12:29:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 12:29:03 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 12:29:03 [DEBUG   ] Finished updating board flags in 1.408 seconds
2012-08-08 12:29:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 12:29:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 12:29:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 12:30:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:30:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:30:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:30:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:30:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:30:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 12:30:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 12:30:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 12:30:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 12:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:30:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:30:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 12:30:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 3
2012-08-08 12:30:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 12:30:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:30:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 12:30:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 12:30:03 [DEBUG   ] Finished updating board flags in 1.364 seconds
2012-08-08 12:30:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 12:30:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 12:30:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 12:31:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:31:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:31:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:31:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:31:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:31:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 12:31:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 12:31:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-08 12:31:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 12:31:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:31:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 12:31:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 12:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:31:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 12:31:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:31:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 12:31:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 12:31:03 [DEBUG   ] Finished updating board flags in 1.342 seconds
2012-08-08 12:31:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 12:31:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 12:31:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 12:32:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:32:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:32:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:32:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:32:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:32:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 12:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:32:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 12:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 12:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 12:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 12:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:32:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 12:32:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 12:32:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 12:32:04 [DEBUG   ] Finished updating board flags in 1.495 seconds
2012-08-08 12:32:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 12:32:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 12:32:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 12:33:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:33:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:33:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:33:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:33:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:33:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 12:33:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-08 12:33:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 12:33:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:33:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 12:33:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 12:33:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 12:33:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 12:33:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 12:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:33:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:33:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:33:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 12:33:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 12:33:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 12:33:04 [DEBUG   ] Finished updating board flags in 1.275 seconds
2012-08-08 12:33:08 [DEBUG   ] Got command RPT from MCS: ref #5412
2012-08-08 12:33:08 [DEBUG   ] summary = ERROR
2012-08-08 12:33:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5412  13 56147 45188381 A  ERRORERROR'
2012-08-08 12:33:08 [DEBUG   ] Got command RPT from MCS: ref #5413
2012-08-08 12:33:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 12:33:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5413  77 56147 45188381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 12:33:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 12:33:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 12:33:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 12:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:34:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 12:34:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-08 12:34:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:34:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 12:34:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 12:34:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 12:34:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 12:34:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2012-08-08 12:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:34:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:34:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 12:34:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 12:34:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:34:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-08 12:34:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 12:34:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 12:34:04 [DEBUG   ] Finished updating board flags in 1.334 seconds
2012-08-08 12:34:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 12:34:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 12:34:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 12:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:35:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 12:35:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 12:35:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 12:35:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 12:35:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 12:35:03 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 12:35:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 12:35:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 12:35:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 12:35:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 12:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:35:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-08 12:35:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 12:35:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 12:35:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:35:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 12:35:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 12:35:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-08 12:35:04 [DEBUG   ] Finished updating board flags in 1.367 seconds
2012-08-08 12:35:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 12:35:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 12:35:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 12:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:36:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 12:36:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 12:36:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2012-08-08 12:36:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 12:36:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 12:36:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:36:03 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 12:36:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 12:36:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 12:36:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 12:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:36:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-08 12:36:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:36:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 12:36:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:36:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 12:36:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 12:36:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 12:36:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 12:36:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-08 12:36:04 [DEBUG   ] Finished updating board flags in 1.365 seconds
2012-08-08 12:36:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 12:36:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 12:36:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 12:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:37:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 12:37:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 12:37:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 12:37:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 12:37:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:37:03 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 12:37:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2012-08-08 12:37:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 12:37:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 12:37:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 12:37:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 12:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:37:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-08 12:37:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:37:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 3
2012-08-08 12:37:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:37:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 12:37:04 [DEBUG   ] Finished updating board flags in 1.544 seconds
2012-08-08 12:37:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 12:37:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 12:37:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 12:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:38:03 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 12:38:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 12:38:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 12:38:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 12:38:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 12:38:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 3
2012-08-08 12:38:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 12:38:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 12:38:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:38:04 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 12:38:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 12:38:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 12:38:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 12:38:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 12:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:38:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:38:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:38:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 12:38:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 12:38:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 12:38:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-08 12:38:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 12:38:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-08 12:38:05 [DEBUG   ] Finished updating board flags in 1.480 seconds
2012-08-08 12:38:08 [DEBUG   ] Got command RPT from MCS: ref #5429
2012-08-08 12:38:08 [DEBUG   ] summary = ERROR
2012-08-08 12:38:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5429  13 56147 45488377 A  ERRORERROR'
2012-08-08 12:38:08 [DEBUG   ] Got command RPT from MCS: ref #5430
2012-08-08 12:38:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 12:38:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5430  77 56147 45488377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 12:38:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 12:38:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 12:38:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 12:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:39:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 12:39:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 12:39:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2012-08-08 12:39:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:39:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 12:39:04 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 12:39:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 12:39:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 12:39:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 12:39:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 12:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:39:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-08 12:39:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:39:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 12:39:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 12:39:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:39:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 12:39:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 3
2012-08-08 12:39:05 [DEBUG   ] Finished updating board flags in 1.648 seconds
2012-08-08 12:39:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 12:39:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 12:39:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 12:40:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:40:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:40:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:40:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:40:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:40:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 12:40:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2012-08-08 12:40:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 12:40:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 12:40:04 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 12:40:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 12:40:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 12:40:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 3
2012-08-08 12:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:40:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 2
2012-08-08 12:40:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:40:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:40:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 12:40:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 12:40:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 12:40:05 [DEBUG   ] Finished updating board flags in 1.482 seconds
2012-08-08 12:40:18 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2012-08-08 12:40:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 12:40:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 12:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:41:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 12:41:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2012-08-08 12:41:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 12:41:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 12:41:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 12:41:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 12:41:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:41:04 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 12:41:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 12:41:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 12:41:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 12:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:41:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2012-08-08 12:41:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-08 12:41:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:41:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-08 12:41:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 12:41:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 12:41:05 [DEBUG   ] Finished updating board flags in 1.406 seconds
2012-08-08 12:41:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 12:41:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 12:41:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 12:42:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:42:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:42:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:42:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:42:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:42:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 12:42:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 12:42:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 12:42:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 12:42:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:42:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 12:42:04 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 12:42:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 12:42:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 12:42:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 12:42:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 12:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:42:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:42:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 12:42:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 12:42:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:42:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 12:42:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 12:42:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 12:42:05 [DEBUG   ] Finished updating board flags in 1.377 seconds
2012-08-08 12:42:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 12:42:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 12:42:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 12:43:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:43:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:43:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:43:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:43:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:43:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 12:43:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 12:43:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-08 12:43:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 12:43:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 12:43:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:43:04 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 12:43:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 12:43:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 12:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:43:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-08 12:43:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:43:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:43:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 12:43:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 2
2012-08-08 12:43:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 12:43:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 12:43:05 [DEBUG   ] Finished updating board flags in 1.241 seconds
2012-08-08 12:43:08 [DEBUG   ] Got command RPT from MCS: ref #5446
2012-08-08 12:43:08 [DEBUG   ] summary = ERROR
2012-08-08 12:43:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5446  13 56147 45788377 A  ERRORERROR'
2012-08-08 12:43:08 [DEBUG   ] Got command RPT from MCS: ref #5447
2012-08-08 12:43:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 12:43:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5447  77 56147 45788377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 12:43:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 12:43:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 12:43:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 12:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:44:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 12:44:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 12:44:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2012-08-08 12:44:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 12:44:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:44:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 12:44:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 12:44:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2012-08-08 12:44:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 12:44:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 12:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:44:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:44:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-08 12:44:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:44:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 12:44:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 12:44:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 12:44:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 12:44:05 [DEBUG   ] Finished updating board flags in 1.248 seconds
2012-08-08 12:44:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 12:44:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 12:44:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 12:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:45:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 12:45:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 12:45:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 12:45:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:45:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 12:45:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 12:45:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 12:45:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 12:45:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 12:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:45:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-08 12:45:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2012-08-08 12:45:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 12:45:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:45:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 12:45:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 12:45:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 4
2012-08-08 12:45:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 12:45:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 12:45:05 [DEBUG   ] Finished updating board flags in 1.317 seconds
2012-08-08 12:45:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 12:45:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 12:45:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 12:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:46:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 12:46:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:46:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 12:46:04 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 12:46:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 12:46:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 12:46:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 12:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:46:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:46:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 12:46:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:46:05 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 12:46:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 12:46:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 12:46:05 [DEBUG   ] Finished updating board flags in 1.320 seconds
2012-08-08 12:46:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 12:46:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 12:46:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 12:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 12:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 12:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 12:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 12:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 12:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 12:47:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 12:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 12:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 12:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 12:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:47:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 12:47:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:47:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:47:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 12:47:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-08 12:47:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 12:47:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 12:47:05 [DEBUG   ] Finished updating board flags in 1.436 seconds
2012-08-08 12:47:18 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2012-08-08 12:47:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 12:47:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 12:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:48:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 12:48:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2012-08-08 12:48:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 12:48:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:48:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 12:48:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 12:48:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 12:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:48:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:48:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 12:48:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:48:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 12:48:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 12:48:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 12:48:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 12:48:05 [DEBUG   ] Finished updating board flags in 1.441 seconds
2012-08-08 12:48:08 [DEBUG   ] Got command RPT from MCS: ref #5463
2012-08-08 12:48:08 [DEBUG   ] summary = ERROR
2012-08-08 12:48:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5463  13 56147 46088385 A  ERRORERROR'
2012-08-08 12:48:08 [DEBUG   ] Got command RPT from MCS: ref #5464
2012-08-08 12:48:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 12:48:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5464  77 56147 46088385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 12:48:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 12:48:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 12:48:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 12:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:49:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 12:49:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 12:49:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 12:49:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 12:49:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 12:49:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:49:04 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 12:49:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 12:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:49:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-08 12:49:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 4
2012-08-08 12:49:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:49:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 12:49:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 12:49:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:49:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 12:49:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 12:49:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 12:49:05 [DEBUG   ] Finished updating board flags in 1.653 seconds
2012-08-08 12:49:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 12:49:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 12:49:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 12:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:50:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 12:50:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 12:50:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2012-08-08 12:50:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 12:50:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 12:50:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:50:04 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 12:50:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 12:50:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 12:50:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 12:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:50:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:50:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 12:50:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 12:50:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:50:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 12:50:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 12:50:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-08 12:50:05 [DEBUG   ] Finished updating board flags in 1.621 seconds
2012-08-08 12:50:18 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2012-08-08 12:50:39 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-08 12:50:59 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-08 12:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:51:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 12:51:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 12:51:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2012-08-08 12:51:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 12:51:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:51:04 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 12:51:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2012-08-08 12:51:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 12:51:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 12:51:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-08 12:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:51:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:51:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 12:51:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:51:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 12:51:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 12:51:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 12:51:05 [DEBUG   ] Finished updating board flags in 1.347 seconds
2012-08-08 12:51:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-08 12:51:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 12:51:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 12:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:52:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 12:52:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 12:52:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 12:52:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 12:52:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 12:52:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 12:52:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 12:52:04 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 12:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:52:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:52:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 12:52:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:52:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 12:52:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 12:52:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 5
2012-08-08 12:52:05 [DEBUG   ] Finished updating board flags in 1.240 seconds
2012-08-08 12:52:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 12:52:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 12:52:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 12:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:53:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 12:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 12:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 12:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 2
2012-08-08 12:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 12:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 12:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 3
2012-08-08 12:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 12:53:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 12:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 12:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 12:53:04 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 12:53:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 12:53:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 12:53:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 12:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:53:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 2
2012-08-08 12:53:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 12:53:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:53:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 12:53:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:53:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 12:53:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 12:53:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 12:53:05 [DEBUG   ] Finished updating board flags in 1.242 seconds
2012-08-08 12:53:08 [DEBUG   ] Got command RPT from MCS: ref #5480
2012-08-08 12:53:08 [DEBUG   ] summary = ERROR
2012-08-08 12:53:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5480  13 56147 46388384 A  ERRORERROR'
2012-08-08 12:53:08 [DEBUG   ] Got command RPT from MCS: ref #5481
2012-08-08 12:53:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 12:53:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5481  77 56147 46388385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 12:53:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 12:53:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 12:53:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 12:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 12:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 12:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2012-08-08 12:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 12:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:54:05 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 12:54:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 12:54:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 12:54:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 12:54:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 12:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:54:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-08 12:54:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 12:54:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:54:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 12:54:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 12:54:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 4
2012-08-08 12:54:05 [DEBUG   ] Finished updating board flags in 1.257 seconds
2012-08-08 12:54:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 12:54:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 12:54:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 12:55:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:55:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:55:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:55:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:55:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2012-08-08 12:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 12:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 12:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 12:55:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:55:05 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 12:55:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2012-08-08 12:55:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 12:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:55:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:55:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 12:55:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-08 12:55:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:55:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 12:55:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 12:55:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 12:55:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 12:55:06 [DEBUG   ] Finished updating board flags in 1.447 seconds
2012-08-08 12:55:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 12:55:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 12:55:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 12:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:56:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 12:56:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 12:56:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 12:56:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 12:56:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:56:05 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 12:56:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 12:56:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 12:56:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 12:56:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:56:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:56:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:56:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:56:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:56:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:56:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:56:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-08 12:56:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 12:56:06 [DEBUG   ] Finished updating board flags in 1.505 seconds
2012-08-08 12:56:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 12:56:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 12:56:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 12:57:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:57:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:57:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:57:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:57:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:57:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 12:57:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 12:57:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 12:57:05 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 12:57:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2012-08-08 12:57:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 12:57:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-08 12:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:57:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-08 12:57:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:57:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:57:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 12:57:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 12:57:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-08 12:57:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 12:57:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 12:57:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 12:57:06 [DEBUG   ] Finished updating board flags in 1.482 seconds
2012-08-08 12:57:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 12:57:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 12:57:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 12:58:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:58:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:58:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:58:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:58:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:58:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 12:58:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 12:58:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 12:58:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 12:58:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 12:58:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 12:58:05 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 12:58:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 12:58:05 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 12:58:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 12:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:58:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:58:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:58:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 12:58:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 12:58:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 12:58:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 12:58:06 [DEBUG   ] Finished updating board flags in 1.492 seconds
2012-08-08 12:58:08 [DEBUG   ] Got command RPT from MCS: ref #5497
2012-08-08 12:58:08 [DEBUG   ] summary = ERROR
2012-08-08 12:58:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5497  13 56147 46688388 A  ERRORERROR'
2012-08-08 12:58:08 [DEBUG   ] Got command RPT from MCS: ref #5498
2012-08-08 12:58:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 12:58:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5498  77 56147 46688389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 12:58:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 12:58:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 12:58:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 12:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 12:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 12:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 12:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 12:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 12:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 3
2012-08-08 12:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 12:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 12:59:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 12:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 12:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 12:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 12:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 12:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 12:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 12:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 12:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 12:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 12:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 12:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 12:59:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 12:59:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 12:59:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 12:59:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 12:59:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 12:59:06 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 12:59:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 12:59:06 [DEBUG   ] Finished updating board flags in 1.489 seconds
2012-08-08 12:59:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 12:59:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 12:59:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 13:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 13:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 13:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 13:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 13:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 13:00:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-08 13:00:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2012-08-08 13:00:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 13:00:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 13:00:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 13:00:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 13:00:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 13:00:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2012-08-08 13:00:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 13:00:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 13:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 13:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 13:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 13:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 13:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 13:00:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2012-08-08 13:00:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-08 13:00:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 13:00:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 13:00:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-08 13:00:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 13:00:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 13:00:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 13:00:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 13:00:06 [DEBUG   ] Finished updating board flags in 1.505 seconds
2012-08-08 13:00:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 13:00:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 13:00:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 13:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 13:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 13:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 13:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 13:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 13:01:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 13:01:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 13:01:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 13:01:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 13:01:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 13:01:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 13:01:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 13:01:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 13:01:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 13:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 13:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 13:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 13:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 13:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 13:01:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-08 13:01:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 13:01:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 13:01:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 13:01:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 13:01:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 13:01:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 13:01:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 13:01:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-08 13:01:06 [DEBUG   ] Finished updating board flags in 1.502 seconds
2012-08-08 13:01:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 13:01:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 13:01:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 13:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 13:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 13:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 13:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 13:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 13:02:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 13:02:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 13:02:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 13:02:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 13:02:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 13:02:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 13:02:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 13:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 13:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 13:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 13:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 13:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 13:02:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 13:02:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-08 13:02:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 13:02:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 13:02:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 13:02:06 [DEBUG   ] Finished updating board flags in 1.512 seconds
2012-08-08 13:02:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 13:02:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 13:02:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 13:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 13:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 13:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 13:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 13:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 13:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 13:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 13:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 13:03:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 13:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 13:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 13:03:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 13:03:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 13:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 13:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 13:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 13:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 13:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 13:03:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-08 13:03:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 13:03:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 13:03:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 13:03:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 13:03:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 13:03:07 [DEBUG   ] Finished updating board flags in 1.651 seconds
2012-08-08 13:03:08 [DEBUG   ] Got command RPT from MCS: ref #5514
2012-08-08 13:03:08 [DEBUG   ] summary = ERROR
2012-08-08 13:03:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5514  13 56147 46988381 A  ERRORERROR'
2012-08-08 13:03:08 [DEBUG   ] Got command RPT from MCS: ref #5515
2012-08-08 13:03:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 13:03:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5515  77 56147 46988381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 13:03:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 13:03:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 13:03:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 13:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 13:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 13:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 13:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 13:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 13:04:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 13:04:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 13:04:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 13:04:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 13:04:05 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 13:04:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 13:04:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 13:04:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 13:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 13:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 13:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 13:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 13:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 13:04:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 13:04:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 13:04:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-08 13:04:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 13:04:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 13:04:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 13:04:06 [DEBUG   ] Finished updating board flags in 1.288 seconds
2012-08-08 13:04:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 13:04:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 13:04:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 13:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 13:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 13:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 13:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 13:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 13:05:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 13:05:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 13:05:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 13:05:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 2
2012-08-08 13:05:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 13:05:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 13:05:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 13:05:05 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa30, chip 2
2012-08-08 13:05:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 13:05:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 13:05:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 13:05:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-08 13:05:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 13:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 13:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 13:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 13:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 13:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 13:05:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 13:05:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 13:05:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 13:05:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-08 13:05:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 13:05:06 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 13:05:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 13:05:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 13:05:06 [DEBUG   ] Finished updating board flags in 1.234 seconds
2012-08-08 13:05:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 13:05:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 13:05:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 13:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 13:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 13:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 13:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 13:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 13:06:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 13:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 13:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 13:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 3
2012-08-08 13:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 13:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 13:06:05 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa30, chip 2
2012-08-08 13:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 13:06:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 13:06:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 13:06:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2012-08-08 13:06:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 13:06:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 13:06:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 13:06:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 13:06:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 13:06:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 13:06:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-08 13:06:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 2
2012-08-08 13:06:06 [DEBUG   ] Finished updating board flags in 1.234 seconds
2012-08-08 13:06:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 13:06:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 13:06:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 13:07:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 13:07:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 13:07:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 13:07:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 13:07:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 13:07:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-08 13:07:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 13:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 13:07:05 [WARNING ] MonitorFlags: Temperature 83.70 > 80 on hostname lwa30, chip 2
2012-08-08 13:07:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 3
2012-08-08 13:07:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 13:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 13:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 13:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 13:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 13:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 13:07:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 13:07:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 13:07:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 13:07:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-08 13:07:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 13:07:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 2
2012-08-08 13:07:06 [DEBUG   ] Finished updating board flags in 1.237 seconds
2012-08-08 13:07:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 13:07:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 13:07:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 13:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 13:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 13:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 13:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 13:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 13:08:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-08 13:08:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 13:08:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 13:08:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 13:08:06 [WARNING ] MonitorFlags: Temperature 83.70 > 80 on hostname lwa30, chip 2
2012-08-08 13:08:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-08 13:08:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 13:08:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 13:08:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 13:08:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 13:08:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 13:08:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 13:08:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 13:08:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 13:08:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-08 13:08:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 13:08:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 13:08:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 13:08:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-08 13:08:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-08 13:08:06 [DEBUG   ] Finished updating board flags in 1.238 seconds
2012-08-08 13:08:08 [DEBUG   ] Got command RPT from MCS: ref #5531
2012-08-08 13:08:08 [DEBUG   ] summary = ERROR
2012-08-08 13:08:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5531  13 56147 47288381 A  ERRORERROR'
2012-08-08 13:08:08 [DEBUG   ] Got command RPT from MCS: ref #5532
2012-08-08 13:08:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 13:08:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5532  77 56147 47288381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 13:08:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 13:08:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 13:08:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 13:09:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 13:09:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 13:09:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 13:09:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 13:09:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 13:09:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-08 13:09:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 13:09:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 13:09:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 13:09:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 13:09:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 13:09:06 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa30, chip 2
2012-08-08 13:09:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 13:09:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 13:09:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 13:09:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2012-08-08 13:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 13:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 13:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 13:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 13:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 13:09:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 13:09:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 13:09:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 13:09:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 13:09:07 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 13:09:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-08 13:09:07 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 13:09:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 13:09:07 [DEBUG   ] Finished updating board flags in 1.585 seconds
2012-08-08 13:09:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 13:09:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 13:09:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 13:10:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 13:10:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 13:10:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 13:10:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 13:10:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 13:10:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 13:10:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 13:10:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 13:10:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 13:10:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 13:10:06 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa30, chip 2
2012-08-08 13:10:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 13:10:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 13:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 13:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 13:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 13:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 13:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 13:10:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 13:10:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 13:10:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 13:10:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 13:10:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-08 13:10:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 3
2012-08-08 13:10:07 [DEBUG   ] Finished updating board flags in 1.456 seconds
2012-08-08 13:10:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 13:10:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 13:10:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 13:11:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 13:11:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 13:11:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 13:11:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 13:11:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 13:11:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 13:11:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 13:11:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 13:11:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 13:11:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 13:11:06 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa30, chip 2
2012-08-08 13:11:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 13:11:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 13:11:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 13:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 13:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 13:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 13:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 13:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 13:11:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 13:11:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 13:11:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-08 13:11:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 13:11:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-08 13:11:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 4
2012-08-08 13:11:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-08 13:11:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 3
2012-08-08 13:11:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-08 13:11:07 [DEBUG   ] Finished updating board flags in 1.458 seconds
2012-08-08 13:11:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 13:11:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 13:11:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 13:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 13:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 13:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 13:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 13:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 13:12:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 13:12:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 13:12:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 13:12:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 13:12:06 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 13:12:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 13:12:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 13:12:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 13:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 13:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 13:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 13:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 13:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 13:12:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-08 13:12:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 13:12:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 13:12:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 13:12:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 13:12:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 13:12:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-08 13:12:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 13:12:07 [DEBUG   ] Finished updating board flags in 1.460 seconds
2012-08-08 13:12:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 13:12:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 13:12:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 13:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 13:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 13:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 13:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 13:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 13:13:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 13:13:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 13:13:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 13:13:06 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 13:13:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 13:13:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 13:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 13:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 13:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 13:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 13:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 13:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 13:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 13:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 13:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 13:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 13:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 13:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-08 13:13:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 13:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 2
2012-08-08 13:13:07 [DEBUG   ] Finished updating board flags in 1.461 seconds
2012-08-08 13:13:08 [DEBUG   ] Got command RPT from MCS: ref #5548
2012-08-08 13:13:08 [DEBUG   ] summary = ERROR
2012-08-08 13:13:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5548  13 56147 47588393 A  ERRORERROR'
2012-08-08 13:13:08 [DEBUG   ] Got command RPT from MCS: ref #5549
2012-08-08 13:13:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 13:13:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5549  77 56147 47588393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 13:13:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 13:13:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 13:13:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 13:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 13:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 13:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 13:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 13:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 13:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 13:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 13:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 13:14:06 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 13:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 13:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 13:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2012-08-08 13:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 13:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 13:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 13:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 13:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 13:14:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 13:14:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 13:14:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 13:14:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 13:14:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 13:14:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-08 13:14:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 13:14:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 13:14:07 [DEBUG   ] Finished updating board flags in 1.461 seconds
2012-08-08 13:14:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 13:14:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 13:14:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 13:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 13:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 13:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 13:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 13:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 13:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 13:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 13:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 13:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 13:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 13:15:06 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 13:15:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 13:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 13:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 13:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 13:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 13:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 13:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-08 13:15:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 13:15:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 13:15:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 13:15:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-08 13:15:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 13:15:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 13:15:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 1
2012-08-08 13:15:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 13:15:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 13:15:07 [DEBUG   ] Finished updating board flags in 1.473 seconds
2012-08-08 13:15:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 13:15:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 13:15:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 13:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 13:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 13:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 13:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 13:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 13:16:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 13:16:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 13:16:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 13:16:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 13:16:06 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 13:16:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 13:16:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-08 13:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 13:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 13:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 13:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 13:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 13:16:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 13:16:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 13:16:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 13:16:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 13:16:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 13:16:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 13:16:07 [DEBUG   ] Finished updating board flags in 1.493 seconds
2012-08-08 13:16:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 13:16:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 13:16:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 13:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 13:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 13:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 13:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 13:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 13:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 13:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 13:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 13:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 13:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 13:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 13:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 13:17:06 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 13:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 13:17:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 13:17:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 13:17:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 13:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 13:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 13:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 13:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 13:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 13:17:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-08 13:17:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 13:17:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 13:17:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 13:17:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 13:17:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 13:17:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 13:17:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 13:17:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 13:17:07 [DEBUG   ] Finished updating board flags in 1.686 seconds
2012-08-08 13:17:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 13:17:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-08 13:17:59 [DEBUG   ] Finished updating ant stats in 0.407 seconds
2012-08-08 13:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 13:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 13:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 13:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 13:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 13:18:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 13:18:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 13:18:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 13:18:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 13:18:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 13:18:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 13:18:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 13:18:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 13:18:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 13:18:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 13:18:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 13:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 13:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 13:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 13:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 13:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 13:18:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 13:18:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 13:18:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 13:18:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 13:18:08 [DEBUG   ] Finished updating board flags in 1.647 seconds
2012-08-08 13:18:08 [DEBUG   ] Got command RPT from MCS: ref #5568
2012-08-08 13:18:08 [DEBUG   ] summary = ERROR
2012-08-08 13:18:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5568  13 56147 47888389 A  ERRORERROR'
2012-08-08 13:18:08 [DEBUG   ] Got command RPT from MCS: ref #5569
2012-08-08 13:18:08 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 13:18:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5569  77 56147 47888389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 13:18:20 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-08 13:18:40 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-08 13:19:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 13:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 13:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 13:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 13:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 13:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 13:19:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2012-08-08 13:19:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 13:19:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 13:19:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 13:19:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 4
2012-08-08 13:19:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-08 13:19:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 13:19:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 13:19:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 13:19:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 13:19:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 13:19:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 13:19:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 13:19:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 13:19:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 13:19:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-08 13:19:07 [DEBUG   ] Finished updating board flags in 1.312 seconds
2012-08-08 13:19:20 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2012-08-08 13:19:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 13:20:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 13:20:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2012-08-08 13:20:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2012-08-08 13:20:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2012-08-08 13:20:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2012-08-08 13:20:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2012-08-08 13:20:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 13:20:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 13:20:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa30, chip 2
2012-08-08 13:20:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 13:20:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 13:20:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2012-08-08 13:20:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2012-08-08 13:20:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2012-08-08 13:20:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2012-08-08 13:20:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2012-08-08 13:20:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 13:20:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 13:20:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 13:20:07 [DEBUG   ] Finished updating board flags in 1.248 seconds
2012-08-08 13:20:20 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2012-08-08 13:20:26 [DEBUG   ] Got command RPT from MCS: ref #5592
2012-08-08 13:20:26 [DEBUG   ] summary = ERROR
2012-08-08 13:20:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5592  13 56147 48026121 A  ERRORERROR'
2012-08-08 13:20:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 13:20:44 [DEBUG   ] Got command INI from MCS: ref #5593
2012-08-08 13:20:44 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2012-08-08 13:20:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI     5593   8 56147 48044388 ABOOTING'
2012-08-08 13:21:04 [INFO    ] -------------------
2012-08-08 13:21:04 [INFO    ]  LWA board status
2012-08-08 13:21:04 [INFO    ] -------------------
2012-08-08 13:21:04 [INFO    ] DP 1: 2 lwa27
2012-08-08 13:21:04 [INFO    ] DP 1: 3 lwa24
2012-08-08 13:21:04 [INFO    ] DP 1: 4 lwa23
2012-08-08 13:21:04 [INFO    ] DP 1: 5 lwa18
2012-08-08 13:21:04 [INFO    ] DP 1: 6 lwa10
2012-08-08 13:21:04 [INFO    ] DP 1: 7 lwa32
2012-08-08 13:21:04 [INFO    ] DP 1: 8 lwa11
2012-08-08 13:21:04 [INFO    ] DP 1: 9 lwa30
2012-08-08 13:21:04 [INFO    ] DP 1: 10 lwa12
2012-08-08 13:21:04 [INFO    ] DP 1: 11 lwa8
2012-08-08 13:21:04 [INFO    ] DP 1: 12 lwa13
2012-08-08 13:21:04 [INFO    ] DP 1: 13 lwa26
2012-08-08 13:21:04 [INFO    ] DP 1: 14 lwa14
2012-08-08 13:21:04 [INFO    ] DP 1: 16 lwa22
2012-08-08 13:21:04 [INFO    ] DP 1: 17 lwa20
2012-08-08 13:21:04 [INFO    ] DP 1: 18 lwa1
2012-08-08 13:21:04 [INFO    ] DP 1: 19 lwa5
2012-08-08 13:21:04 [INFO    ] DP 1: 20 lwa25
2012-08-08 13:21:04 [INFO    ] DP 1: 21 lwa35
2012-08-08 13:21:04 [INFO    ] DP 1: 22 lwa19
2012-08-08 13:21:04 [INFO    ] DP 1: 23 lwa21
2012-08-08 13:21:04 [INFO    ] DP 1: 24 lwa6
2012-08-08 13:21:04 [INFO    ] DP 1: 25 lwa7
2012-08-08 13:21:04 [INFO    ] DP 1: 26 lwa33
2012-08-08 13:21:04 [INFO    ] DP 1: 27 lwa15
2012-08-08 13:21:04 [INFO    ] DP 1: 28 lwa28
2012-08-08 13:21:04 [INFO    ] DP 2: 1 lwa16
2012-08-08 13:21:04 [INFO    ] DP 2: 15 lwa34
2012-08-08 13:21:04 [INFO    ] Total of 28 boards
2012-08-08 13:21:04 [INFO    ] Total of 260 stands
2012-08-08 13:21:04 [INFO    ] -------------------
2012-08-08 13:21:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1797
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1798
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1799
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1800
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1801
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1802
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1803
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1804
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1805
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1806
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1807
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1808
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1809
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1810
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1811
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1812
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1813
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1814
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1815
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1816
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1817
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1818
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1819
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1820
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1821
2012-08-08 13:21:11 [DEBUG   ] 2012-08-08 13:21:11 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1822
2012-08-08 13:21:12 [DEBUG   ] Got command RPT from MCS: ref #5594
2012-08-08 13:21:12 [DEBUG   ] summary = BOOTING
2012-08-08 13:21:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5594  15 56147 48072304 ABOOTINGBOOTING'
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1797 exited with status 0
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1798 exited with status 0
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1799 exited with status 0
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1800 exited with status 0
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1801 exited with status 0
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1802 exited with status 0
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1803 exited with status 0
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1804 exited with status 0
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1805 exited with status 0
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1806 exited with status 0
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1807 exited with status 0
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1808 exited with status 0
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1809 exited with status 0
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1810 exited with status 0
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1811 exited with status 0
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1812 exited with status 0
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1813 exited with status 0
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1814 exited with status 0
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1815 exited with status 0
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1816 exited with status 0
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1817 exited with status 0
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1818 exited with status 0
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1819 exited with status 0
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1820 exited with status 0
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1821 exited with status 0
2012-08-08 13:21:23 [DEBUG   ] 2012-08-08 13:21:23 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1822 exited with status 0
2012-08-08 13:21:23 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2012-08-08 13:21:23 [DEBUG   ] spawn_process: at 2012-08-08 13:21:23 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:23 [DEBUG   ] spawn_process: at 2012-08-08 13:21:23 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:23 [DEBUG   ] spawn_process: at 2012-08-08 13:21:23 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:24 [DEBUG   ] spawn_process: at 2012-08-08 13:21:24 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:24 [DEBUG   ] spawn_process: at 2012-08-08 13:21:24 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:24 [DEBUG   ] spawn_process: at 2012-08-08 13:21:24 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:24 [DEBUG   ] spawn_process: at 2012-08-08 13:21:24 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:24 [DEBUG   ] spawn_process: at 2012-08-08 13:21:24 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:24 [DEBUG   ] spawn_process: at 2012-08-08 13:21:24 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:24 [DEBUG   ] spawn_process: at 2012-08-08 13:21:24 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:24 [DEBUG   ] spawn_process: at 2012-08-08 13:21:24 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:24 [DEBUG   ] spawn_process: at 2012-08-08 13:21:24 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:24 [DEBUG   ] spawn_process: at 2012-08-08 13:21:24 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:24 [DEBUG   ] spawn_process: at 2012-08-08 13:21:24 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:24 [DEBUG   ] spawn_process: at 2012-08-08 13:21:24 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:24 [DEBUG   ] spawn_process: at 2012-08-08 13:21:24 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:24 [DEBUG   ] spawn_process: at 2012-08-08 13:21:24 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:24 [DEBUG   ] spawn_process: at 2012-08-08 13:21:24 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:24 [DEBUG   ] spawn_process: at 2012-08-08 13:21:24 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:24 [DEBUG   ] spawn_process: at 2012-08-08 13:21:24 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:24 [DEBUG   ] spawn_process: at 2012-08-08 13:21:24 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:24 [DEBUG   ] spawn_process: at 2012-08-08 13:21:24 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:24 [DEBUG   ] spawn_process: at 2012-08-08 13:21:24 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:24 [DEBUG   ] spawn_process: at 2012-08-08 13:21:24 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:24 [DEBUG   ] spawn_process: at 2012-08-08 13:21:24 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:24 [DEBUG   ] spawn_process: at 2012-08-08 13:21:24 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2012-08-08 13:21:24 [DEBUG   ] 2012-08-08 13:21:24 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 1849
2012-08-08 13:21:24 [DEBUG   ] 2012-08-08 13:21:24 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 1850
2012-08-08 13:21:29 [DEBUG   ] 2012-08-08 13:21:29 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 1849 exited with status 0
2012-08-08 13:21:29 [DEBUG   ] 2012-08-08 13:21:29 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 1850 exited with status 0
2012-08-08 13:21:29 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2012-08-08 13:21:29 [DEBUG   ] spawn_process: at 2012-08-08 13:21:29 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2012-08-08 13:21:29 [DEBUG   ] spawn_process: at 2012-08-08 13:21:29 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2012-08-08 13:21:29 [INFO    ] Setting Beam 1 xbars
2012-08-08 13:21:29 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2012-08-08 13:21:29 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2012-08-08 13:21:29 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2012-08-08 13:21:29 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2012-08-08 13:21:30 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2012-08-08 13:21:30 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2012-08-08 13:21:30 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2012-08-08 13:21:30 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2012-08-08 13:21:30 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2012-08-08 13:21:30 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2012-08-08 13:21:30 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2012-08-08 13:21:30 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2012-08-08 13:21:30 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2012-08-08 13:21:31 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2012-08-08 13:21:31 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2012-08-08 13:21:31 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2012-08-08 13:21:31 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2012-08-08 13:21:31 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2012-08-08 13:21:31 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2012-08-08 13:21:31 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2012-08-08 13:21:31 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2012-08-08 13:21:31 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2012-08-08 13:21:32 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2012-08-08 13:21:32 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2012-08-08 13:21:32 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2012-08-08 13:21:32 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2012-08-08 13:21:32 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2012-08-08 13:21:32 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2012-08-08 13:21:32 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2012-08-08 13:21:32 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2012-08-08 13:21:32 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2012-08-08 13:21:33 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2012-08-08 13:21:33 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2012-08-08 13:21:33 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2012-08-08 13:21:33 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2012-08-08 13:21:33 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2012-08-08 13:21:33 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2012-08-08 13:21:33 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2012-08-08 13:21:33 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2012-08-08 13:21:33 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2012-08-08 13:21:34 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2012-08-08 13:21:34 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2012-08-08 13:21:34 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2012-08-08 13:21:34 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2012-08-08 13:21:34 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2012-08-08 13:21:34 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2012-08-08 13:21:34 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2012-08-08 13:21:34 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2012-08-08 13:21:34 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2012-08-08 13:21:34 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2012-08-08 13:21:35 [INFO    ] Setting Beam 2 xbars
2012-08-08 13:21:35 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2012-08-08 13:21:35 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2012-08-08 13:21:35 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2012-08-08 13:21:35 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2012-08-08 13:21:35 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2012-08-08 13:21:35 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2012-08-08 13:21:35 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2012-08-08 13:21:35 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2012-08-08 13:21:35 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2012-08-08 13:21:36 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2012-08-08 13:21:36 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2012-08-08 13:21:36 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2012-08-08 13:21:36 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2012-08-08 13:21:36 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2012-08-08 13:21:36 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2012-08-08 13:21:36 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2012-08-08 13:21:36 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2012-08-08 13:21:36 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2012-08-08 13:21:37 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2012-08-08 13:21:37 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2012-08-08 13:21:37 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2012-08-08 13:21:37 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2012-08-08 13:21:37 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2012-08-08 13:21:37 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2012-08-08 13:21:37 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2012-08-08 13:21:37 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2012-08-08 13:21:37 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2012-08-08 13:21:38 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2012-08-08 13:21:38 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2012-08-08 13:21:38 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2012-08-08 13:21:38 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2012-08-08 13:21:38 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2012-08-08 13:21:38 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2012-08-08 13:21:38 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2012-08-08 13:21:38 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2012-08-08 13:21:38 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2012-08-08 13:21:39 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2012-08-08 13:21:39 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2012-08-08 13:21:39 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2012-08-08 13:21:39 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2012-08-08 13:21:39 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2012-08-08 13:21:39 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2012-08-08 13:21:39 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2012-08-08 13:21:39 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2012-08-08 13:21:39 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2012-08-08 13:21:39 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2012-08-08 13:21:40 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2012-08-08 13:21:40 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2012-08-08 13:21:40 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2012-08-08 13:21:40 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2012-08-08 13:21:40 [INFO    ] Setting Beam 3 xbars
2012-08-08 13:21:40 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2012-08-08 13:21:40 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2012-08-08 13:21:40 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2012-08-08 13:21:40 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2012-08-08 13:21:40 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2012-08-08 13:21:41 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2012-08-08 13:21:41 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2012-08-08 13:21:41 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2012-08-08 13:21:41 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2012-08-08 13:21:41 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2012-08-08 13:21:41 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2012-08-08 13:21:41 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2012-08-08 13:21:41 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2012-08-08 13:21:41 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2012-08-08 13:21:42 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2012-08-08 13:21:42 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2012-08-08 13:21:42 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2012-08-08 13:21:42 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2012-08-08 13:21:42 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2012-08-08 13:21:42 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2012-08-08 13:21:42 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2012-08-08 13:21:42 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2012-08-08 13:21:42 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2012-08-08 13:21:43 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2012-08-08 13:21:43 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2012-08-08 13:21:43 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2012-08-08 13:21:43 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2012-08-08 13:21:43 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2012-08-08 13:21:43 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2012-08-08 13:21:43 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2012-08-08 13:21:43 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2012-08-08 13:21:43 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2012-08-08 13:21:43 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2012-08-08 13:21:44 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2012-08-08 13:21:44 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2012-08-08 13:21:44 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2012-08-08 13:21:44 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2012-08-08 13:21:44 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2012-08-08 13:21:44 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2012-08-08 13:21:44 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2012-08-08 13:21:44 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2012-08-08 13:21:44 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2012-08-08 13:21:45 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2012-08-08 13:21:45 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2012-08-08 13:21:45 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2012-08-08 13:21:45 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2012-08-08 13:21:45 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2012-08-08 13:21:45 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2012-08-08 13:21:45 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2012-08-08 13:21:45 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2012-08-08 13:21:45 [INFO    ] Setting Beam 4 xbars
2012-08-08 13:21:45 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2012-08-08 13:21:46 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 13:21:46 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 13:21:46 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 13:21:46 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 13:21:46 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2012-08-08 13:21:46 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2012-08-08 13:21:46 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2012-08-08 13:21:46 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2012-08-08 13:21:46 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2012-08-08 13:21:47 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2012-08-08 13:21:47 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2012-08-08 13:21:47 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2012-08-08 13:21:47 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2012-08-08 13:21:47 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2012-08-08 13:21:47 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2012-08-08 13:21:47 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2012-08-08 13:21:47 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2012-08-08 13:21:47 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2012-08-08 13:21:48 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2012-08-08 13:21:48 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2012-08-08 13:21:48 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2012-08-08 13:21:48 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2012-08-08 13:21:48 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2012-08-08 13:21:48 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2012-08-08 13:21:48 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2012-08-08 13:21:48 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2012-08-08 13:21:48 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2012-08-08 13:21:48 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2012-08-08 13:21:49 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2012-08-08 13:21:49 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2012-08-08 13:21:49 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2012-08-08 13:21:49 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2012-08-08 13:21:49 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2012-08-08 13:21:49 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2012-08-08 13:21:49 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2012-08-08 13:21:49 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2012-08-08 13:21:49 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2012-08-08 13:21:50 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2012-08-08 13:21:50 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2012-08-08 13:21:50 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2012-08-08 13:21:50 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2012-08-08 13:21:50 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2012-08-08 13:21:50 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2012-08-08 13:21:50 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2012-08-08 13:21:50 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2012-08-08 13:21:50 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2012-08-08 13:21:51 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2012-08-08 13:21:51 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2012-08-08 13:21:51 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2012-08-08 13:21:51 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2012-08-08 13:21:51 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2012-08-08 13:21:51 [INFO    ] All xbars set
2012-08-08 13:21:51 [INFO    ] Setting adder chain routing for all beams
2012-08-08 13:21:56 [INFO    ] Setting beam ids
2012-08-08 13:22:06 [INFO    ] Starting beam delay calibration
2012-08-08 13:22:18 [INFO    ] Beam 1 latency is 5726
2012-08-08 13:22:18 [INFO    ] Beam 2 latency is 5766
2012-08-08 13:22:18 [INFO    ] Beam 3 latency is 5758
2012-08-08 13:22:18 [INFO    ] Beam 4 latency is 5722
2012-08-08 13:22:18 [INFO    ] Stop calibration
2012-08-08 13:22:26 [INFO    ] Beam delay calibration successful
2012-08-08 13:22:26 [INFO    ] Calibration passed
2012-08-08 13:22:26 [DEBUG   ] spawn_process: at 2012-08-08 13:22:26 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2012-08-08 13:22:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2012-08-08 13:22:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2012-08-08 13:22:26 [DEBUG   ] spawn_process: at 2012-08-08 13:22:26 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2012-08-08 13:22:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2012-08-08 13:22:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2012-08-08 13:22:26 [DEBUG   ] spawn_process: at 2012-08-08 13:22:26 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2012-08-08 13:22:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2012-08-08 13:22:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2012-08-08 13:22:26 [DEBUG   ] spawn_process: at 2012-08-08 13:22:26 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2012-08-08 13:22:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2012-08-08 13:22:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2012-08-08 13:22:27 [DEBUG   ] Finished updating ant stats in 0.683 seconds
2012-08-08 13:22:27 [INFO    ] Started antennas statistics background thread
2012-08-08 13:22:27 [INFO    ] Started board flags background thread
2012-08-08 13:22:27 [INFO    ] Started BAM background thread
2012-08-08 13:22:27 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 with PID 3481
2012-08-08 13:22:27 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 with PID 3484
2012-08-08 13:22:27 [INFO    ] Finished the INI process in 103.412 s
2012-08-08 13:22:28 [DEBUG   ] Finished updating board flags in 0.821 seconds
2012-08-08 13:22:45 [DEBUG   ] Got command RPT from MCS: ref #5595
2012-08-08 13:22:45 [DEBUG   ] summary = NORMAL
2012-08-08 13:22:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5595  14 56147 48165233 A NORMALNORMAL'
2012-08-08 13:22:47 [DEBUG   ] Finished updating ant stats in 0.593 seconds
2012-08-08 13:23:07 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:23:08 [DEBUG   ] Got command RPT from MCS: ref #5596
2012-08-08 13:23:08 [DEBUG   ] summary = NORMAL
2012-08-08 13:23:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5596  14 56147 48188392 A NORMALNORMAL'
2012-08-08 13:23:08 [DEBUG   ] Got command RPT from MCS: ref #5597
2012-08-08 13:23:08 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 13:23:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5597  48 56147 48188393 A NORMALSystem calibrated and operating normally'
2012-08-08 13:23:27 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 13:23:28 [DEBUG   ] Finished updating board flags in 0.823 seconds
2012-08-08 13:23:47 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:24:06 [DEBUG   ] Got command RPT from MCS: ref #5616
2012-08-08 13:24:06 [DEBUG   ] summary = NORMAL
2012-08-08 13:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5616  14 56147 48246129 A NORMALNORMAL'
2012-08-08 13:24:06 [DEBUG   ] Got command RPT from MCS: ref #5617
2012-08-08 13:24:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 13:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5617  48 56147 48246129 A NORMALSystem calibrated and operating normally'
2012-08-08 13:24:07 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 13:24:27 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 13:24:28 [DEBUG   ] Finished updating board flags in 0.986 seconds
2012-08-08 13:24:47 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:25:07 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:25:27 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 13:25:28 [DEBUG   ] Finished updating board flags in 1.179 seconds
2012-08-08 13:25:47 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:26:07 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 13:26:27 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 13:26:29 [DEBUG   ] Finished updating board flags in 1.044 seconds
2012-08-08 13:26:47 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:27:07 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 13:27:27 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:27:28 [DEBUG   ] Finished updating board flags in 0.988 seconds
2012-08-08 13:27:47 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:28:07 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 13:28:27 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:28:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa34, chip 1
2012-08-08 13:28:29 [DEBUG   ] Finished updating board flags in 0.990 seconds
2012-08-08 13:28:47 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 13:29:06 [DEBUG   ] Got command RPT from MCS: ref #5633
2012-08-08 13:29:06 [DEBUG   ] summary = NORMAL
2012-08-08 13:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5633  14 56147 48546137 A NORMALNORMAL'
2012-08-08 13:29:06 [DEBUG   ] Got command RPT from MCS: ref #5634
2012-08-08 13:29:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 13:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5634  48 56147 48546137 A NORMALSystem calibrated and operating normally'
2012-08-08 13:29:07 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:29:27 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:29:29 [DEBUG   ] Finished updating board flags in 1.110 seconds
2012-08-08 13:29:47 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:30:07 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:30:27 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:30:29 [DEBUG   ] Finished updating board flags in 0.812 seconds
2012-08-08 13:30:47 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:31:07 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:31:27 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:31:29 [DEBUG   ] Finished updating board flags in 0.832 seconds
2012-08-08 13:31:47 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:32:07 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:32:27 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:32:29 [DEBUG   ] Finished updating board flags in 0.838 seconds
2012-08-08 13:32:47 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:33:07 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:33:27 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:33:29 [DEBUG   ] Finished updating board flags in 0.839 seconds
2012-08-08 13:33:47 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:34:06 [DEBUG   ] Got command RPT from MCS: ref #5650
2012-08-08 13:34:06 [DEBUG   ] summary = NORMAL
2012-08-08 13:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5650  14 56147 48846137 A NORMALNORMAL'
2012-08-08 13:34:06 [DEBUG   ] Got command RPT from MCS: ref #5651
2012-08-08 13:34:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 13:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5651  48 56147 48846137 A NORMALSystem calibrated and operating normally'
2012-08-08 13:34:07 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 13:34:27 [DEBUG   ] Finished updating ant stats in 0.408 seconds
2012-08-08 13:34:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2012-08-08 13:34:29 [DEBUG   ] Finished updating board flags in 0.977 seconds
2012-08-08 13:34:47 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 13:35:07 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:35:27 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:35:29 [DEBUG   ] Finished updating board flags in 1.018 seconds
2012-08-08 13:35:47 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 13:36:07 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:36:27 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:36:29 [DEBUG   ] Finished updating board flags in 1.182 seconds
2012-08-08 13:36:47 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 13:37:07 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:37:27 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:37:30 [DEBUG   ] Finished updating board flags in 1.509 seconds
2012-08-08 13:37:47 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:38:07 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 13:38:27 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:38:29 [DEBUG   ] Finished updating board flags in 0.813 seconds
2012-08-08 13:38:47 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:39:06 [DEBUG   ] Got command RPT from MCS: ref #5667
2012-08-08 13:39:06 [DEBUG   ] summary = NORMAL
2012-08-08 13:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5667  14 56147 49146133 A NORMALNORMAL'
2012-08-08 13:39:06 [DEBUG   ] Got command RPT from MCS: ref #5668
2012-08-08 13:39:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 13:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5668  48 56147 49146133 A NORMALSystem calibrated and operating normally'
2012-08-08 13:39:07 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 13:39:27 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:39:29 [DEBUG   ] Finished updating board flags in 0.828 seconds
2012-08-08 13:39:47 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:40:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 13:40:28 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2012-08-08 13:40:29 [DEBUG   ] Finished updating board flags in 0.828 seconds
2012-08-08 13:40:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 13:41:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 13:41:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 13:41:29 [DEBUG   ] Finished updating board flags in 0.840 seconds
2012-08-08 13:41:48 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2012-08-08 13:42:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 13:42:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 13:42:30 [DEBUG   ] Finished updating board flags in 0.845 seconds
2012-08-08 13:42:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 13:43:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 13:43:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 13:43:30 [DEBUG   ] Finished updating board flags in 1.117 seconds
2012-08-08 13:43:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 13:44:06 [DEBUG   ] Got command RPT from MCS: ref #5684
2012-08-08 13:44:06 [DEBUG   ] summary = NORMAL
2012-08-08 13:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5684  14 56147 49446169 A NORMALNORMAL'
2012-08-08 13:44:06 [DEBUG   ] Got command RPT from MCS: ref #5685
2012-08-08 13:44:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 13:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5685  48 56147 49446169 A NORMALSystem calibrated and operating normally'
2012-08-08 13:44:08 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:44:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 13:44:30 [DEBUG   ] Finished updating board flags in 0.954 seconds
2012-08-08 13:44:49 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 13:45:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 13:45:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 13:45:30 [DEBUG   ] Finished updating board flags in 0.840 seconds
2012-08-08 13:45:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 13:46:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 13:46:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 13:46:30 [DEBUG   ] Finished updating board flags in 0.934 seconds
2012-08-08 13:46:49 [DEBUG   ] Finished updating ant stats in 0.792 seconds
2012-08-08 13:47:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 13:47:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 13:47:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa34, chip 1
2012-08-08 13:47:30 [DEBUG   ] Finished updating board flags in 0.930 seconds
2012-08-08 13:47:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 13:48:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 13:48:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 13:48:30 [DEBUG   ] Finished updating board flags in 1.177 seconds
2012-08-08 13:48:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 13:49:06 [DEBUG   ] Got command RPT from MCS: ref #5701
2012-08-08 13:49:06 [DEBUG   ] summary = NORMAL
2012-08-08 13:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5701  14 56147 49746133 A NORMALNORMAL'
2012-08-08 13:49:06 [DEBUG   ] Got command RPT from MCS: ref #5702
2012-08-08 13:49:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 13:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5702  48 56147 49746133 A NORMALSystem calibrated and operating normally'
2012-08-08 13:49:09 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:49:30 [DEBUG   ] Finished updating ant stats in 1.232 seconds
2012-08-08 13:49:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2012-08-08 13:49:31 [DEBUG   ] Finished updating board flags in 1.035 seconds
2012-08-08 13:49:50 [DEBUG   ] Finished updating ant stats in 1.173 seconds
2012-08-08 13:50:10 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 13:50:30 [DEBUG   ] Finished updating ant stats in 1.032 seconds
2012-08-08 13:50:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2012-08-08 13:50:31 [DEBUG   ] Finished updating board flags in 1.042 seconds
2012-08-08 13:50:50 [DEBUG   ] Finished updating ant stats in 0.968 seconds
2012-08-08 13:51:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 13:51:30 [DEBUG   ] Finished updating ant stats in 0.832 seconds
2012-08-08 13:51:31 [DEBUG   ] Finished updating board flags in 1.054 seconds
2012-08-08 13:51:50 [DEBUG   ] Finished updating ant stats in 0.768 seconds
2012-08-08 13:52:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 13:52:30 [DEBUG   ] Finished updating ant stats in 0.432 seconds
2012-08-08 13:52:31 [DEBUG   ] Finished updating board flags in 1.017 seconds
2012-08-08 13:52:50 [DEBUG   ] Finished updating ant stats in 0.372 seconds
2012-08-08 13:53:11 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2012-08-08 13:53:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 13:53:32 [DEBUG   ] Finished updating board flags in 1.888 seconds
2012-08-08 13:53:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 13:54:06 [DEBUG   ] Got command RPT from MCS: ref #5718
2012-08-08 13:54:06 [DEBUG   ] summary = NORMAL
2012-08-08 13:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5718  14 56147 50046137 A NORMALNORMAL'
2012-08-08 13:54:06 [DEBUG   ] Got command RPT from MCS: ref #5719
2012-08-08 13:54:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 13:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5719  48 56147 50046137 A NORMALSystem calibrated and operating normally'
2012-08-08 13:54:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 13:54:31 [DEBUG   ] Finished updating board flags in 0.878 seconds
2012-08-08 13:54:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 13:54:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 13:55:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 13:55:31 [DEBUG   ] Finished updating ant stats in 0.823 seconds
2012-08-08 13:55:31 [DEBUG   ] Finished updating board flags in 1.081 seconds
2012-08-08 13:55:51 [DEBUG   ] Finished updating ant stats in 0.780 seconds
2012-08-08 13:56:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 13:56:31 [DEBUG   ] Finished updating ant stats in 0.624 seconds
2012-08-08 13:56:31 [DEBUG   ] Finished updating board flags in 1.054 seconds
2012-08-08 13:56:51 [DEBUG   ] Finished updating ant stats in 0.576 seconds
2012-08-08 13:57:11 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 13:57:31 [DEBUG   ] Finished updating ant stats in 0.422 seconds
2012-08-08 13:57:31 [DEBUG   ] Finished updating board flags in 0.962 seconds
2012-08-08 13:57:51 [DEBUG   ] Finished updating ant stats in 0.380 seconds
2012-08-08 13:58:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 13:58:31 [DEBUG   ] Finished updating board flags in 0.860 seconds
2012-08-08 13:58:32 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2012-08-08 13:58:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-08 13:59:06 [DEBUG   ] Got command RPT from MCS: ref #5735
2012-08-08 13:59:06 [DEBUG   ] summary = NORMAL
2012-08-08 13:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5735  14 56147 50346141 A NORMALNORMAL'
2012-08-08 13:59:06 [DEBUG   ] Got command RPT from MCS: ref #5736
2012-08-08 13:59:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 13:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5736  48 56147 50346141 A NORMALSystem calibrated and operating normally'
2012-08-08 13:59:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 13:59:31 [DEBUG   ] Finished updating board flags in 0.831 seconds
2012-08-08 13:59:32 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2012-08-08 13:59:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 14:00:12 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2012-08-08 14:00:14 [DEBUG   ] Got command TBW from MCS: ref #5754
2012-08-08 14:00:14 [DEBUG   ] tbw = exited with status True, code 0x00
2012-08-08 14:00:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW     5754   8 56147 50414293 A NORMAL'
2012-08-08 14:00:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2012-08-08 14:00:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2012-08-08 14:00:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2012-08-08 14:00:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2012-08-08 14:00:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2012-08-08 14:00:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2012-08-08 14:00:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2012-08-08 14:00:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2012-08-08 14:00:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2012-08-08 14:00:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2012-08-08 14:00:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2012-08-08 14:00:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2012-08-08 14:00:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2012-08-08 14:00:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2012-08-08 14:00:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2012-08-08 14:00:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2012-08-08 14:00:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2012-08-08 14:00:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2012-08-08 14:00:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2012-08-08 14:00:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2012-08-08 14:00:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2012-08-08 14:00:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2012-08-08 14:00:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2012-08-08 14:00:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2012-08-08 14:00:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2012-08-08 14:00:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2012-08-08 14:00:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2012-08-08 14:00:16 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2012-08-08 14:00:16 [DEBUG   ] spawn_process: at 2012-08-08 14:00:16 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2012-08-08 14:00:16 [INFO    ] Finished spawning TBW
2012-08-08 14:00:31 [DEBUG   ] Finished updating board flags in 0.878 seconds
2012-08-08 14:01:32 [DEBUG   ] Finished updating board flags in 1.270 seconds
2012-08-08 14:02:32 [DEBUG   ] Finished updating board flags in 1.232 seconds
2012-08-08 14:03:31 [DEBUG   ] Finished updating board flags in 1.082 seconds
2012-08-08 14:03:55 [INFO    ] __waitForTBW - TBW finished in 218.654 s
2012-08-08 14:03:56 [DEBUG   ] Finished updating ant stats in 0.917 seconds
2012-08-08 14:03:56 [INFO    ] Started antennas statistics background thread
2012-08-08 14:03:56 [INFO    ] Resuming TBN at 52.000 MHz after TBW acquisition
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '1', '1344434637']
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '2', '1344434637']
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '3', '1344434637']
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '4', '1344434637']
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '5', '1344434637']
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '6', '1344434637']
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '7', '1344434637']
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '8', '1344434637']
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '9', '1344434637']
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '10', '1344434637']
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '11', '1344434637']
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '12', '1344434637']
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '13', '1344434637']
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '14', '1344434637']
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '15', '1344434637']
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '16', '1344434637']
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '17', '1344434637']
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '18', '1344434637']
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '19', '1344434637']
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '20', '1344434637']
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '21', '1344434637']
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '22', '1344434637']
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '23', '1344434637']
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '24', '1344434637']
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '25', '1344434637']
2012-08-08 14:03:56 [DEBUG   ] spawn_process: at 2012-08-08 14:03:56 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '26', '1344434637']
2012-08-08 14:03:56 [INFO    ] Finished spawning TBN in 0.047 s
2012-08-08 14:04:06 [DEBUG   ] Got command RPT from MCS: ref #5763
2012-08-08 14:04:06 [DEBUG   ] summary = NORMAL
2012-08-08 14:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5763  14 56147 50646144 A NORMALNORMAL'
2012-08-08 14:04:06 [DEBUG   ] Got command RPT from MCS: ref #5764
2012-08-08 14:04:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 14:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5764  48 56147 50646145 A NORMALSystem calibrated and operating normally'
2012-08-08 14:04:16 [DEBUG   ] Finished updating ant stats in 0.870 seconds
2012-08-08 14:04:32 [DEBUG   ] Finished updating board flags in 1.371 seconds
2012-08-08 14:04:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 14:04:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 14:05:16 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 14:05:32 [DEBUG   ] Finished updating board flags in 1.376 seconds
2012-08-08 14:05:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 14:05:57 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2012-08-08 14:06:17 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-08 14:06:32 [DEBUG   ] Finished updating board flags in 1.385 seconds
2012-08-08 14:06:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 14:06:57 [DEBUG   ] Finished updating ant stats in 1.184 seconds
2012-08-08 14:07:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 14:07:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2012-08-08 14:07:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2012-08-08 14:07:32 [CRITICAL] MGT underflow detected on beam(s) 1
2012-08-08 14:07:32 [DEBUG   ] Finished updating board flags in 1.439 seconds
2012-08-08 14:07:37 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2012-08-08 14:07:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 14:08:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 14:08:32 [DEBUG   ] Finished updating board flags in 1.223 seconds
2012-08-08 14:08:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 14:08:57 [DEBUG   ] Finished updating ant stats in 0.588 seconds
2012-08-08 14:09:06 [DEBUG   ] Got command RPT from MCS: ref #5782
2012-08-08 14:09:06 [DEBUG   ] summary = ERROR
2012-08-08 14:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5782  13 56147 50946141 A  ERRORERROR'
2012-08-08 14:09:06 [DEBUG   ] Got command RPT from MCS: ref #5783
2012-08-08 14:09:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 14:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5783  77 56147 50946141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 14:09:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 14:09:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2012-08-08 14:09:32 [CRITICAL] MGT underflow detected on beam(s) 1
2012-08-08 14:09:32 [DEBUG   ] Finished updating board flags in 1.243 seconds
2012-08-08 14:09:37 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 14:09:58 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-08 14:10:18 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-08 14:10:32 [DEBUG   ] Finished updating board flags in 1.234 seconds
2012-08-08 14:10:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 14:10:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 14:11:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 14:11:27 [DEBUG   ] Got command TBW from MCS: ref #5801
2012-08-08 14:11:27 [DEBUG   ] tbw = exited with status True, code 0x00
2012-08-08 14:11:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW     5801   8 56147 51087229 A  ERROR'
2012-08-08 14:11:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2012-08-08 14:11:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2012-08-08 14:11:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2012-08-08 14:11:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2012-08-08 14:11:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2012-08-08 14:11:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2012-08-08 14:11:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2012-08-08 14:11:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2012-08-08 14:11:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2012-08-08 14:11:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2012-08-08 14:11:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2012-08-08 14:11:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2012-08-08 14:11:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2012-08-08 14:11:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2012-08-08 14:11:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2012-08-08 14:11:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2012-08-08 14:11:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2012-08-08 14:11:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2012-08-08 14:11:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2012-08-08 14:11:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2012-08-08 14:11:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2012-08-08 14:11:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2012-08-08 14:11:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2012-08-08 14:11:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2012-08-08 14:11:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2012-08-08 14:11:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2012-08-08 14:11:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2012-08-08 14:11:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2012-08-08 14:11:30 [DEBUG   ] spawn_process: at 2012-08-08 14:11:30 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2012-08-08 14:11:30 [INFO    ] Finished spawning TBW
2012-08-08 14:11:32 [DEBUG   ] Finished updating board flags in 0.856 seconds
2012-08-08 14:12:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2012-08-08 14:12:32 [DEBUG   ] Finished updating board flags in 1.083 seconds
2012-08-08 14:13:32 [DEBUG   ] Finished updating board flags in 1.073 seconds
2012-08-08 14:14:06 [DEBUG   ] Got command RPT from MCS: ref #5808
2012-08-08 14:14:06 [DEBUG   ] summary = ERROR
2012-08-08 14:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5808  13 56147 51246149 A  ERRORERROR'
2012-08-08 14:14:06 [DEBUG   ] Got command RPT from MCS: ref #5809
2012-08-08 14:14:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 14:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5809  77 56147 51246149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 14:14:33 [DEBUG   ] Finished updating board flags in 1.255 seconds
2012-08-08 14:15:09 [INFO    ] __waitForTBW - TBW finished in 218.590 s
2012-08-08 14:15:10 [DEBUG   ] Finished updating ant stats in 0.930 seconds
2012-08-08 14:15:10 [INFO    ] Started antennas statistics background thread
2012-08-08 14:15:10 [INFO    ] Resuming TBN at 52.000 MHz after TBW acquisition
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '1', '1344435311']
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '2', '1344435311']
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '3', '1344435311']
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '4', '1344435311']
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '5', '1344435311']
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '6', '1344435311']
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '7', '1344435311']
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '8', '1344435311']
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '9', '1344435311']
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '10', '1344435311']
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '11', '1344435311']
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '12', '1344435311']
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '13', '1344435311']
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '14', '1344435311']
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '15', '1344435311']
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '16', '1344435311']
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '17', '1344435311']
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '18', '1344435311']
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '19', '1344435311']
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '20', '1344435311']
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '21', '1344435311']
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '22', '1344435311']
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '23', '1344435311']
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '24', '1344435311']
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '25', '1344435311']
2012-08-08 14:15:10 [DEBUG   ] spawn_process: at 2012-08-08 14:15:10 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '26', '1344435311']
2012-08-08 14:15:10 [INFO    ] Finished spawning TBN in 0.046 s
2012-08-08 14:15:30 [DEBUG   ] Finished updating ant stats in 0.874 seconds
2012-08-08 14:15:33 [DEBUG   ] Finished updating board flags in 1.493 seconds
2012-08-08 14:15:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 14:16:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 14:16:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 14:16:33 [DEBUG   ] Finished updating board flags in 1.504 seconds
2012-08-08 14:16:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 14:17:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 14:17:30 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-08 14:17:33 [DEBUG   ] Finished updating board flags in 1.538 seconds
2012-08-08 14:17:50 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-08 14:18:10 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-08 14:18:30 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 14:18:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa34, chip 1
2012-08-08 14:18:33 [DEBUG   ] Finished updating board flags in 1.503 seconds
2012-08-08 14:18:50 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2012-08-08 14:19:06 [DEBUG   ] Got command RPT from MCS: ref #5829
2012-08-08 14:19:06 [DEBUG   ] summary = ERROR
2012-08-08 14:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5829  13 56147 51546149 A  ERRORERROR'
2012-08-08 14:19:06 [DEBUG   ] Got command RPT from MCS: ref #5830
2012-08-08 14:19:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 14:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5830  77 56147 51546149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 14:19:11 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-08 14:19:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 14:19:33 [DEBUG   ] Finished updating board flags in 1.500 seconds
2012-08-08 14:19:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-08 14:20:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 14:20:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 14:20:33 [DEBUG   ] Finished updating board flags in 1.641 seconds
2012-08-08 14:20:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 14:21:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 14:21:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 14:21:33 [DEBUG   ] Finished updating board flags in 1.310 seconds
2012-08-08 14:21:51 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-08 14:22:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-08 14:22:29 [DEBUG   ] Got command TBW from MCS: ref #5848
2012-08-08 14:22:29 [DEBUG   ] tbw = exited with status True, code 0x00
2012-08-08 14:22:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW     5848   8 56147 51749461 A  ERROR'
2012-08-08 14:22:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2012-08-08 14:22:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2012-08-08 14:22:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2012-08-08 14:22:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2012-08-08 14:22:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2012-08-08 14:22:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2012-08-08 14:22:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2012-08-08 14:22:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2012-08-08 14:22:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2012-08-08 14:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2012-08-08 14:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2012-08-08 14:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2012-08-08 14:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2012-08-08 14:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2012-08-08 14:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2012-08-08 14:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2012-08-08 14:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2012-08-08 14:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2012-08-08 14:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2012-08-08 14:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2012-08-08 14:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2012-08-08 14:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2012-08-08 14:22:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2012-08-08 14:22:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2012-08-08 14:22:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2012-08-08 14:22:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2012-08-08 14:22:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2012-08-08 14:22:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2012-08-08 14:22:33 [DEBUG   ] Finished updating board flags in 0.947 seconds
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2012-08-08 14:22:33 [DEBUG   ] spawn_process: at 2012-08-08 14:22:33 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2012-08-08 14:22:33 [INFO    ] Finished spawning TBW
2012-08-08 14:23:33 [DEBUG   ] Finished updating board flags in 1.093 seconds
2012-08-08 14:24:06 [DEBUG   ] Got command RPT from MCS: ref #5853
2012-08-08 14:24:06 [DEBUG   ] summary = ERROR
2012-08-08 14:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5853  13 56147 51846149 A  ERRORERROR'
2012-08-08 14:24:06 [DEBUG   ] Got command RPT from MCS: ref #5854
2012-08-08 14:24:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 14:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5854  77 56147 51846149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 14:24:34 [DEBUG   ] Finished updating board flags in 1.377 seconds
2012-08-08 14:25:34 [DEBUG   ] Finished updating board flags in 1.131 seconds
2012-08-08 14:26:11 [INFO    ] __waitForTBW - TBW finished in 218.276 s
2012-08-08 14:26:12 [DEBUG   ] Finished updating ant stats in 0.472 seconds
2012-08-08 14:26:12 [INFO    ] Started antennas statistics background thread
2012-08-08 14:26:12 [INFO    ] Resuming TBN at 52.000 MHz after TBW acquisition
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '1', '1344435974']
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '2', '1344435974']
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '3', '1344435974']
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '4', '1344435974']
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '5', '1344435974']
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '6', '1344435974']
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '7', '1344435974']
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '8', '1344435974']
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '9', '1344435974']
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '10', '1344435974']
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '11', '1344435974']
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '12', '1344435974']
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '13', '1344435974']
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '14', '1344435974']
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '15', '1344435974']
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '16', '1344435974']
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '17', '1344435974']
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '18', '1344435974']
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '19', '1344435974']
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '20', '1344435974']
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '21', '1344435974']
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '22', '1344435974']
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '23', '1344435974']
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '24', '1344435974']
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '25', '1344435974']
2012-08-08 14:26:12 [DEBUG   ] spawn_process: at 2012-08-08 14:26:12 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '26', '1344435974']
2012-08-08 14:26:12 [INFO    ] Finished spawning TBN in 0.049 s
2012-08-08 14:26:32 [DEBUG   ] Finished updating ant stats in 0.472 seconds
2012-08-08 14:26:34 [DEBUG   ] Finished updating board flags in 1.508 seconds
2012-08-08 14:26:53 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-08 14:27:13 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-08 14:27:33 [DEBUG   ] Finished updating ant stats in 1.258 seconds
2012-08-08 14:27:34 [DEBUG   ] Finished updating board flags in 1.543 seconds
2012-08-08 14:27:53 [DEBUG   ] Finished updating ant stats in 1.149 seconds
2012-08-08 14:28:13 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 14:28:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 14:28:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2012-08-08 14:28:34 [DEBUG   ] Finished updating board flags in 1.702 seconds
2012-08-08 14:28:53 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-08 14:29:06 [DEBUG   ] Got command RPT from MCS: ref #5876
2012-08-08 14:29:06 [DEBUG   ] summary = ERROR
2012-08-08 14:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5876  13 56147 52146153 A  ERRORERROR'
2012-08-08 14:29:06 [DEBUG   ] Got command RPT from MCS: ref #5877
2012-08-08 14:29:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 14:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5877  77 56147 52146153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 14:29:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 14:29:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 14:29:35 [DEBUG   ] Finished updating board flags in 1.618 seconds
2012-08-08 14:29:53 [DEBUG   ] Finished updating ant stats in 0.791 seconds
2012-08-08 14:30:13 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-08 14:30:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 14:30:34 [DEBUG   ] Finished updating board flags in 1.303 seconds
2012-08-08 14:30:53 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2012-08-08 14:31:13 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2012-08-08 14:31:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 14:31:34 [DEBUG   ] Finished updating ant stats in 1.244 seconds
2012-08-08 14:31:34 [DEBUG   ] Finished updating board flags in 1.296 seconds
2012-08-08 14:31:54 [DEBUG   ] Finished updating ant stats in 1.163 seconds
2012-08-08 14:32:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-08 14:32:34 [DEBUG   ] Finished updating ant stats in 1.045 seconds
2012-08-08 14:32:34 [DEBUG   ] Finished updating board flags in 1.277 seconds
2012-08-08 14:32:54 [DEBUG   ] Finished updating ant stats in 0.961 seconds
2012-08-08 14:33:04 [DEBUG   ] Got command TBW from MCS: ref #5895
2012-08-08 14:33:04 [DEBUG   ] tbw = exited with status True, code 0x00
2012-08-08 14:33:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW     5895   8 56147 52384581 A  ERROR'
2012-08-08 14:33:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2012-08-08 14:33:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2012-08-08 14:33:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2012-08-08 14:33:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2012-08-08 14:33:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2012-08-08 14:33:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2012-08-08 14:33:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2012-08-08 14:33:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2012-08-08 14:33:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2012-08-08 14:33:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2012-08-08 14:33:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2012-08-08 14:33:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2012-08-08 14:33:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2012-08-08 14:33:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2012-08-08 14:33:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2012-08-08 14:33:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2012-08-08 14:33:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2012-08-08 14:33:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2012-08-08 14:33:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2012-08-08 14:33:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2012-08-08 14:33:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2012-08-08 14:33:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2012-08-08 14:33:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2012-08-08 14:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2012-08-08 14:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2012-08-08 14:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2012-08-08 14:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2012-08-08 14:33:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2012-08-08 14:33:08 [DEBUG   ] spawn_process: at 2012-08-08 14:33:08 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2012-08-08 14:33:08 [INFO    ] Finished spawning TBW
2012-08-08 14:33:34 [DEBUG   ] Finished updating board flags in 0.863 seconds
2012-08-08 14:34:06 [DEBUG   ] Got command RPT from MCS: ref #5899
2012-08-08 14:34:06 [DEBUG   ] summary = ERROR
2012-08-08 14:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5899  13 56147 52446145 A  ERRORERROR'
2012-08-08 14:34:06 [DEBUG   ] Got command RPT from MCS: ref #5900
2012-08-08 14:34:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 14:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5900  77 56147 52446145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 14:34:35 [DEBUG   ] Finished updating board flags in 1.285 seconds
2012-08-08 14:35:35 [DEBUG   ] Finished updating board flags in 1.221 seconds
2012-08-08 14:36:34 [DEBUG   ] Finished updating board flags in 1.086 seconds
2012-08-08 14:36:47 [INFO    ] __waitForTBW - TBW finished in 218.828 s
2012-08-08 14:36:48 [INFO    ] Started antennas statistics background thread
2012-08-08 14:36:48 [INFO    ] Resuming TBN at 52.000 MHz after TBW acquisition
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '1', '1344436609']
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '2', '1344436609']
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '3', '1344436609']
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '4', '1344436609']
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '5', '1344436609']
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '6', '1344436609']
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '7', '1344436609']
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '8', '1344436609']
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '9', '1344436609']
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '10', '1344436609']
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '11', '1344436609']
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '12', '1344436609']
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '13', '1344436609']
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '14', '1344436609']
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '15', '1344436609']
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '16', '1344436609']
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '17', '1344436609']
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '18', '1344436609']
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '19', '1344436609']
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '20', '1344436609']
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '21', '1344436609']
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '22', '1344436609']
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '23', '1344436609']
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '24', '1344436609']
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '25', '1344436609']
2012-08-08 14:36:48 [DEBUG   ] spawn_process: at 2012-08-08 14:36:48 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '26', '1344436609']
2012-08-08 14:36:48 [INFO    ] Finished spawning TBN in 0.053 s
2012-08-08 14:36:48 [DEBUG   ] Finished updating ant stats in 1.071 seconds
2012-08-08 14:37:08 [DEBUG   ] Finished updating ant stats in 1.033 seconds
2012-08-08 14:37:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 14:37:35 [DEBUG   ] Finished updating board flags in 1.378 seconds
2012-08-08 14:37:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 14:38:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 14:38:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 14:38:35 [DEBUG   ] Finished updating board flags in 1.371 seconds
2012-08-08 14:38:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 14:39:06 [DEBUG   ] Got command RPT from MCS: ref #5923
2012-08-08 14:39:06 [DEBUG   ] summary = ERROR
2012-08-08 14:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5923  13 56147 52746149 A  ERRORERROR'
2012-08-08 14:39:06 [DEBUG   ] Got command RPT from MCS: ref #5924
2012-08-08 14:39:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 14:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5924  77 56147 52746149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 14:39:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 14:39:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 14:39:36 [DEBUG   ] Finished updating board flags in 1.850 seconds
2012-08-08 14:39:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 14:40:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 14:40:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-08 14:40:35 [DEBUG   ] Finished updating board flags in 1.374 seconds
2012-08-08 14:40:49 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-08 14:41:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 14:41:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 14:41:35 [DEBUG   ] Finished updating board flags in 1.235 seconds
2012-08-08 14:41:49 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-08 14:42:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 14:42:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-08 14:42:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa34, chip 1
2012-08-08 14:42:35 [DEBUG   ] Finished updating board flags in 1.225 seconds
2012-08-08 14:42:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 14:43:09 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-08 14:43:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 14:43:35 [DEBUG   ] Finished updating board flags in 1.221 seconds
2012-08-08 14:43:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 14:43:54 [DEBUG   ] Got command TBW from MCS: ref #5942
2012-08-08 14:43:54 [DEBUG   ] tbw = exited with status True, code 0x00
2012-08-08 14:43:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW     5942   8 56147 53034345 A  ERROR'
2012-08-08 14:43:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2012-08-08 14:43:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2012-08-08 14:43:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2012-08-08 14:43:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2012-08-08 14:43:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2012-08-08 14:43:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2012-08-08 14:43:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2012-08-08 14:43:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2012-08-08 14:43:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2012-08-08 14:43:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2012-08-08 14:43:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2012-08-08 14:43:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2012-08-08 14:43:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2012-08-08 14:43:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2012-08-08 14:43:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2012-08-08 14:43:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2012-08-08 14:43:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2012-08-08 14:43:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2012-08-08 14:43:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2012-08-08 14:43:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2012-08-08 14:43:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2012-08-08 14:43:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2012-08-08 14:43:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2012-08-08 14:43:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2012-08-08 14:43:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2012-08-08 14:43:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2012-08-08 14:43:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2012-08-08 14:43:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2012-08-08 14:43:58 [DEBUG   ] spawn_process: at 2012-08-08 14:43:58 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2012-08-08 14:43:58 [INFO    ] Finished spawning TBW
2012-08-08 14:44:06 [DEBUG   ] Got command RPT from MCS: ref #5944
2012-08-08 14:44:06 [DEBUG   ] summary = ERROR
2012-08-08 14:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5944  13 56147 53046148 A  ERRORERROR'
2012-08-08 14:44:06 [DEBUG   ] Got command RPT from MCS: ref #5945
2012-08-08 14:44:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 14:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5945  77 56147 53046149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 14:44:35 [DEBUG   ] Finished updating board flags in 0.866 seconds
2012-08-08 14:45:35 [DEBUG   ] Finished updating board flags in 1.083 seconds
2012-08-08 14:46:35 [DEBUG   ] Finished updating board flags in 1.080 seconds
2012-08-08 14:47:36 [DEBUG   ] Finished updating board flags in 1.245 seconds
2012-08-08 14:47:37 [INFO    ] __waitForTBW - TBW finished in 218.941 s
2012-08-08 14:47:38 [DEBUG   ] Finished updating ant stats in 0.934 seconds
2012-08-08 14:47:38 [INFO    ] Started antennas statistics background thread
2012-08-08 14:47:38 [INFO    ] Resuming TBN at 52.000 MHz after TBW acquisition
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '1', '1344437259']
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '2', '1344437259']
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '3', '1344437259']
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '4', '1344437259']
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '5', '1344437259']
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '6', '1344437259']
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '7', '1344437259']
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '8', '1344437259']
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '9', '1344437259']
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '10', '1344437259']
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '11', '1344437259']
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '12', '1344437259']
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '13', '1344437259']
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '14', '1344437259']
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '15', '1344437259']
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '16', '1344437259']
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '17', '1344437259']
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '18', '1344437259']
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '19', '1344437259']
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '20', '1344437259']
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '21', '1344437259']
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '22', '1344437259']
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '23', '1344437259']
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '24', '1344437259']
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '25', '1344437259']
2012-08-08 14:47:38 [DEBUG   ] spawn_process: at 2012-08-08 14:47:38 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '26', '1344437259']
2012-08-08 14:47:38 [INFO    ] Finished spawning TBN in 0.049 s
2012-08-08 14:47:58 [DEBUG   ] Finished updating ant stats in 0.873 seconds
2012-08-08 14:48:18 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 14:48:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 14:48:36 [DEBUG   ] Finished updating board flags in 1.504 seconds
2012-08-08 14:48:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 14:48:59 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2012-08-08 14:49:06 [DEBUG   ] Got command RPT from MCS: ref #5970
2012-08-08 14:49:06 [DEBUG   ] summary = ERROR
2012-08-08 14:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5970  13 56147 53346144 A  ERRORERROR'
2012-08-08 14:49:06 [DEBUG   ] Got command RPT from MCS: ref #5971
2012-08-08 14:49:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 14:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5971  77 56147 53346145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 14:49:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 14:49:36 [DEBUG   ] Finished updating board flags in 1.512 seconds
2012-08-08 14:49:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 14:49:59 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-08 14:50:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 14:50:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2012-08-08 14:50:36 [CRITICAL] MGT underflow detected on beam(s) 1
2012-08-08 14:50:36 [DEBUG   ] Finished updating board flags in 1.517 seconds
2012-08-08 14:50:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-08 14:50:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-08 14:51:19 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 14:51:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2012-08-08 14:51:36 [DEBUG   ] Finished updating board flags in 1.506 seconds
2012-08-08 14:51:39 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-08 14:51:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 14:52:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 14:52:36 [DEBUG   ] Finished updating board flags in 1.500 seconds
2012-08-08 14:52:39 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-08 14:52:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 14:53:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-08 14:53:36 [DEBUG   ] Finished updating board flags in 1.642 seconds
2012-08-08 14:53:39 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-08 14:54:00 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2012-08-08 14:54:06 [DEBUG   ] Got command RPT from MCS: ref #5987
2012-08-08 14:54:06 [DEBUG   ] summary = ERROR
2012-08-08 14:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5987  13 56147 53646157 A  ERRORERROR'
2012-08-08 14:54:06 [DEBUG   ] Got command RPT from MCS: ref #5988
2012-08-08 14:54:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 14:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     5988  77 56147 53646157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 14:54:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 14:54:36 [DEBUG   ] Finished updating board flags in 1.306 seconds
2012-08-08 14:54:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 14:55:00 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-08 14:55:19 [DEBUG   ] Got command TBW from MCS: ref #6006
2012-08-08 14:55:19 [DEBUG   ] tbw = exited with status True, code 0x00
2012-08-08 14:55:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW     6006   8 56147 53719589 A  ERROR'
2012-08-08 14:55:19 [WARNING ] AntennaStats: no access to lwa28
2012-08-08 14:55:19 [WARNING ] AntennaStats: last command was /usr/local/bin/lwa28 /lwa/software/amplitude
2012-08-08 14:55:19 [WARNING ] AntennaStats: last command output as 
2012-08-08 14:55:19 [DEBUG   ] Finished updating ant stats in 0.584 seconds
2012-08-08 14:55:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2012-08-08 14:55:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2012-08-08 14:55:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2012-08-08 14:55:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2012-08-08 14:55:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2012-08-08 14:55:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2012-08-08 14:55:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2012-08-08 14:55:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2012-08-08 14:55:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2012-08-08 14:55:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2012-08-08 14:55:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2012-08-08 14:55:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2012-08-08 14:55:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2012-08-08 14:55:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2012-08-08 14:55:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2012-08-08 14:55:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2012-08-08 14:55:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2012-08-08 14:55:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2012-08-08 14:55:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2012-08-08 14:55:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2012-08-08 14:55:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2012-08-08 14:55:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2012-08-08 14:55:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2012-08-08 14:55:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2012-08-08 14:55:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2012-08-08 14:55:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2012-08-08 14:55:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2012-08-08 14:55:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2012-08-08 14:55:23 [DEBUG   ] spawn_process: at 2012-08-08 14:55:23 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2012-08-08 14:55:23 [INFO    ] Finished spawning TBW
2012-08-08 14:55:36 [DEBUG   ] Finished updating board flags in 0.873 seconds
2012-08-08 14:56:36 [DEBUG   ] Finished updating board flags in 1.071 seconds
2012-08-08 14:57:36 [DEBUG   ] Finished updating board flags in 1.065 seconds
2012-08-08 14:58:36 [DEBUG   ] Finished updating board flags in 1.077 seconds
2012-08-08 14:59:02 [INFO    ] __waitForTBW - TBW finished in 218.668 s
2012-08-08 14:59:03 [INFO    ] Started antennas statistics background thread
2012-08-08 14:59:03 [INFO    ] Resuming TBN at 52.000 MHz after TBW acquisition
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '1', '1344437944']
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '2', '1344437944']
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '3', '1344437944']
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '4', '1344437944']
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '5', '1344437944']
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '6', '1344437944']
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '7', '1344437944']
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '8', '1344437944']
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '9', '1344437944']
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '10', '1344437944']
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '11', '1344437944']
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '12', '1344437944']
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '13', '1344437944']
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '14', '1344437944']
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '15', '1344437944']
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '16', '1344437944']
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '17', '1344437944']
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '18', '1344437944']
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '19', '1344437944']
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '20', '1344437944']
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '21', '1344437944']
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '22', '1344437944']
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '23', '1344437944']
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '24', '1344437944']
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '25', '1344437944']
2012-08-08 14:59:03 [DEBUG   ] spawn_process: at 2012-08-08 14:59:03 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '26', '1344437944']
2012-08-08 14:59:03 [INFO    ] Finished spawning TBN in 0.051 s
2012-08-08 14:59:03 [DEBUG   ] Finished updating ant stats in 1.270 seconds
2012-08-08 14:59:06 [DEBUG   ] Got command RPT from MCS: ref #6015
2012-08-08 14:59:06 [DEBUG   ] summary = ERROR
2012-08-08 14:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6015  13 56147 53946148 A  ERRORERROR'
2012-08-08 14:59:06 [DEBUG   ] Got command RPT from MCS: ref #6016
2012-08-08 14:59:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 14:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6016  77 56147 53946149 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 14:59:23 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2012-08-08 14:59:37 [DEBUG   ] Finished updating board flags in 1.504 seconds
2012-08-08 14:59:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 15:00:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 15:00:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 15:00:37 [DEBUG   ] Finished updating board flags in 1.523 seconds
2012-08-08 15:00:43 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-08 15:01:03 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 15:01:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-08 15:01:37 [DEBUG   ] Finished updating board flags in 1.525 seconds
2012-08-08 15:01:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-08 15:02:03 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-08 15:02:23 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 15:02:37 [DEBUG   ] Finished updating board flags in 1.517 seconds
2012-08-08 15:02:44 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-08 15:03:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 15:03:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-08 15:03:37 [DEBUG   ] Finished updating board flags in 1.515 seconds
2012-08-08 15:03:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 15:04:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-08 15:04:06 [DEBUG   ] Got command RPT from MCS: ref #6034
2012-08-08 15:04:06 [DEBUG   ] summary = ERROR
2012-08-08 15:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6034  13 56147 54246156 A  ERRORERROR'
2012-08-08 15:04:06 [DEBUG   ] Got command RPT from MCS: ref #6035
2012-08-08 15:04:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 15:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6035  77 56147 54246157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 15:04:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 15:04:38 [DEBUG   ] Finished updating board flags in 1.654 seconds
2012-08-08 15:04:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 15:05:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 15:05:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 15:05:37 [DEBUG   ] Finished updating board flags in 1.289 seconds
2012-08-08 15:05:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 15:06:04 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2012-08-08 15:06:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 15:06:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa34, chip 1
2012-08-08 15:06:37 [DEBUG   ] Finished updating board flags in 1.231 seconds
2012-08-08 15:06:45 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-08 15:07:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 15:07:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 15:07:37 [DEBUG   ] Finished updating board flags in 1.227 seconds
2012-08-08 15:07:45 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-08 15:08:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 15:08:25 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 15:08:37 [DEBUG   ] Finished updating board flags in 1.229 seconds
2012-08-08 15:08:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 15:09:05 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-08 15:09:06 [DEBUG   ] Got command RPT from MCS: ref #6051
2012-08-08 15:09:06 [DEBUG   ] summary = ERROR
2012-08-08 15:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6051  13 56147 54546160 A  ERRORERROR'
2012-08-08 15:09:06 [DEBUG   ] Got command RPT from MCS: ref #6052
2012-08-08 15:09:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 15:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6052  77 56147 54546161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 15:09:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 15:09:37 [DEBUG   ] Finished updating board flags in 1.228 seconds
2012-08-08 15:09:46 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2012-08-08 15:10:06 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-08 15:10:26 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2012-08-08 15:10:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 15:10:37 [DEBUG   ] Finished updating board flags in 1.233 seconds
2012-08-08 15:10:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 15:11:06 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-08 15:11:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 15:11:37 [DEBUG   ] Finished updating board flags in 1.229 seconds
2012-08-08 15:11:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 15:12:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 15:12:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 15:12:38 [DEBUG   ] Finished updating board flags in 1.431 seconds
2012-08-08 15:12:46 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2012-08-08 15:13:06 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 15:13:27 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-08 15:13:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 15:13:38 [DEBUG   ] Finished updating board flags in 1.409 seconds
2012-08-08 15:13:47 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-08 15:14:06 [DEBUG   ] Got command RPT from MCS: ref #6068
2012-08-08 15:14:06 [DEBUG   ] summary = ERROR
2012-08-08 15:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6068  13 56147 54846153 A  ERRORERROR'
2012-08-08 15:14:06 [DEBUG   ] Got command RPT from MCS: ref #6069
2012-08-08 15:14:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 15:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6069  77 56147 54846153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 15:14:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 15:14:27 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2012-08-08 15:14:38 [DEBUG   ] Finished updating board flags in 1.388 seconds
2012-08-08 15:14:47 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-08 15:15:00 [DEBUG   ] Got command INI from MCS: ref #6085
2012-08-08 15:15:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2012-08-08 15:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI     6085   8 56147 54900504 ABOOTING'
2012-08-08 15:15:20 [INFO    ] -------------------
2012-08-08 15:15:20 [INFO    ]  LWA board status
2012-08-08 15:15:20 [INFO    ] -------------------
2012-08-08 15:15:20 [INFO    ] DP 1: 2 lwa27
2012-08-08 15:15:20 [INFO    ] DP 1: 3 lwa24
2012-08-08 15:15:20 [INFO    ] DP 1: 4 lwa23
2012-08-08 15:15:20 [INFO    ] DP 1: 5 lwa18
2012-08-08 15:15:20 [INFO    ] DP 1: 6 lwa10
2012-08-08 15:15:20 [INFO    ] DP 1: 7 lwa32
2012-08-08 15:15:20 [INFO    ] DP 1: 8 lwa11
2012-08-08 15:15:20 [INFO    ] DP 1: 9 lwa30
2012-08-08 15:15:20 [INFO    ] DP 1: 10 lwa12
2012-08-08 15:15:20 [INFO    ] DP 1: 11 lwa8
2012-08-08 15:15:20 [INFO    ] DP 1: 12 lwa13
2012-08-08 15:15:20 [INFO    ] DP 1: 13 lwa26
2012-08-08 15:15:20 [INFO    ] DP 1: 14 lwa14
2012-08-08 15:15:20 [INFO    ] DP 1: 16 lwa22
2012-08-08 15:15:20 [INFO    ] DP 1: 17 lwa20
2012-08-08 15:15:20 [INFO    ] DP 1: 18 lwa1
2012-08-08 15:15:20 [INFO    ] DP 1: 19 lwa5
2012-08-08 15:15:20 [INFO    ] DP 1: 20 lwa25
2012-08-08 15:15:20 [INFO    ] DP 1: 21 lwa35
2012-08-08 15:15:20 [INFO    ] DP 1: 22 lwa19
2012-08-08 15:15:20 [INFO    ] DP 1: 23 lwa21
2012-08-08 15:15:20 [INFO    ] DP 1: 24 lwa6
2012-08-08 15:15:20 [INFO    ] DP 1: 25 lwa7
2012-08-08 15:15:20 [INFO    ] DP 1: 26 lwa33
2012-08-08 15:15:20 [INFO    ] DP 1: 27 lwa15
2012-08-08 15:15:20 [INFO    ] DP 1: 28 lwa28
2012-08-08 15:15:20 [INFO    ] DP 2: 1 lwa16
2012-08-08 15:15:20 [INFO    ] DP 2: 15 lwa34
2012-08-08 15:15:20 [INFO    ] Total of 28 boards
2012-08-08 15:15:20 [INFO    ] Total of 260 stands
2012-08-08 15:15:20 [INFO    ] -------------------
2012-08-08 15:15:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15163
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15164
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15165
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15166
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15167
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15168
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15169
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15170
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15171
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15172
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15173
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15174
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15175
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15176
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15177
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15178
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15179
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15180
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15181
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15182
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15183
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15184
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15185
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15186
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15187
2012-08-08 15:15:27 [DEBUG   ] 2012-08-08 15:15:27 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 15188
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15163 exited with status 0
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15164 exited with status 0
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15165 exited with status 0
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15166 exited with status 0
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15167 exited with status 0
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15168 exited with status 0
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15169 exited with status 0
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15170 exited with status 0
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15171 exited with status 0
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15172 exited with status 0
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15173 exited with status 0
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15174 exited with status 0
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15175 exited with status 0
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15176 exited with status 0
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15177 exited with status 0
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15178 exited with status 0
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15179 exited with status 0
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15180 exited with status 0
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15181 exited with status 0
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15182 exited with status 0
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15183 exited with status 0
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15184 exited with status 0
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15185 exited with status 0
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15186 exited with status 0
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15187 exited with status 0
2012-08-08 15:15:39 [DEBUG   ] 2012-08-08 15:15:39 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 15188 exited with status 0
2012-08-08 15:15:39 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2012-08-08 15:15:39 [DEBUG   ] spawn_process: at 2012-08-08 15:15:39 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:39 [DEBUG   ] spawn_process: at 2012-08-08 15:15:39 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:39 [DEBUG   ] spawn_process: at 2012-08-08 15:15:39 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:39 [DEBUG   ] spawn_process: at 2012-08-08 15:15:39 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:39 [DEBUG   ] spawn_process: at 2012-08-08 15:15:39 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:39 [DEBUG   ] spawn_process: at 2012-08-08 15:15:39 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:39 [DEBUG   ] spawn_process: at 2012-08-08 15:15:39 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:39 [DEBUG   ] spawn_process: at 2012-08-08 15:15:39 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:39 [DEBUG   ] spawn_process: at 2012-08-08 15:15:39 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:39 [DEBUG   ] spawn_process: at 2012-08-08 15:15:39 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:39 [DEBUG   ] spawn_process: at 2012-08-08 15:15:39 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:39 [DEBUG   ] spawn_process: at 2012-08-08 15:15:39 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:39 [DEBUG   ] spawn_process: at 2012-08-08 15:15:39 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:39 [DEBUG   ] spawn_process: at 2012-08-08 15:15:39 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:39 [DEBUG   ] spawn_process: at 2012-08-08 15:15:39 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:40 [DEBUG   ] spawn_process: at 2012-08-08 15:15:40 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:40 [DEBUG   ] spawn_process: at 2012-08-08 15:15:40 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:40 [DEBUG   ] spawn_process: at 2012-08-08 15:15:40 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:40 [DEBUG   ] spawn_process: at 2012-08-08 15:15:40 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:40 [DEBUG   ] spawn_process: at 2012-08-08 15:15:40 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:40 [DEBUG   ] spawn_process: at 2012-08-08 15:15:40 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:40 [DEBUG   ] spawn_process: at 2012-08-08 15:15:40 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:40 [DEBUG   ] spawn_process: at 2012-08-08 15:15:40 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:40 [DEBUG   ] spawn_process: at 2012-08-08 15:15:40 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:40 [DEBUG   ] spawn_process: at 2012-08-08 15:15:40 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:40 [DEBUG   ] spawn_process: at 2012-08-08 15:15:40 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2012-08-08 15:15:40 [DEBUG   ] 2012-08-08 15:15:40 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 15215
2012-08-08 15:15:40 [DEBUG   ] 2012-08-08 15:15:40 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 15216
2012-08-08 15:15:45 [DEBUG   ] 2012-08-08 15:15:45 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 15215 exited with status 0
2012-08-08 15:15:45 [DEBUG   ] 2012-08-08 15:15:45 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 15216 exited with status 0
2012-08-08 15:15:45 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2012-08-08 15:15:45 [DEBUG   ] spawn_process: at 2012-08-08 15:15:45 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2012-08-08 15:15:45 [DEBUG   ] spawn_process: at 2012-08-08 15:15:45 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2012-08-08 15:15:45 [INFO    ] Setting Beam 1 xbars
2012-08-08 15:15:45 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2012-08-08 15:15:45 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2012-08-08 15:15:45 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2012-08-08 15:15:45 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2012-08-08 15:15:46 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2012-08-08 15:15:46 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2012-08-08 15:15:46 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2012-08-08 15:15:46 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2012-08-08 15:15:46 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2012-08-08 15:15:46 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2012-08-08 15:15:46 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2012-08-08 15:15:46 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2012-08-08 15:15:46 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2012-08-08 15:15:47 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2012-08-08 15:15:47 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2012-08-08 15:15:47 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2012-08-08 15:15:47 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2012-08-08 15:15:47 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2012-08-08 15:15:47 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2012-08-08 15:15:47 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2012-08-08 15:15:47 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2012-08-08 15:15:47 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2012-08-08 15:15:48 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2012-08-08 15:15:48 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2012-08-08 15:15:48 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2012-08-08 15:15:48 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2012-08-08 15:15:48 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2012-08-08 15:15:48 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2012-08-08 15:15:48 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2012-08-08 15:15:48 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2012-08-08 15:15:48 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2012-08-08 15:15:49 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2012-08-08 15:15:49 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2012-08-08 15:15:49 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2012-08-08 15:15:49 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2012-08-08 15:15:49 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2012-08-08 15:15:49 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2012-08-08 15:15:49 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2012-08-08 15:15:49 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2012-08-08 15:15:49 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2012-08-08 15:15:50 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2012-08-08 15:15:50 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2012-08-08 15:15:50 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2012-08-08 15:15:50 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2012-08-08 15:15:50 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2012-08-08 15:15:50 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2012-08-08 15:15:50 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2012-08-08 15:15:50 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2012-08-08 15:15:50 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2012-08-08 15:15:51 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2012-08-08 15:15:51 [INFO    ] Setting Beam 2 xbars
2012-08-08 15:15:51 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2012-08-08 15:15:51 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2012-08-08 15:15:51 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2012-08-08 15:15:51 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2012-08-08 15:15:51 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2012-08-08 15:15:51 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2012-08-08 15:15:51 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2012-08-08 15:15:51 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2012-08-08 15:15:52 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2012-08-08 15:15:52 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2012-08-08 15:15:52 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2012-08-08 15:15:52 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2012-08-08 15:15:52 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2012-08-08 15:15:52 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2012-08-08 15:15:52 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2012-08-08 15:15:52 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2012-08-08 15:15:52 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2012-08-08 15:15:53 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2012-08-08 15:15:53 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2012-08-08 15:15:53 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2012-08-08 15:15:53 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2012-08-08 15:15:53 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2012-08-08 15:15:53 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2012-08-08 15:15:53 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2012-08-08 15:15:53 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2012-08-08 15:15:53 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2012-08-08 15:15:54 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2012-08-08 15:15:54 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2012-08-08 15:15:54 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2012-08-08 15:15:54 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2012-08-08 15:15:54 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2012-08-08 15:15:54 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2012-08-08 15:15:54 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2012-08-08 15:15:54 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2012-08-08 15:15:54 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2012-08-08 15:15:55 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2012-08-08 15:15:55 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2012-08-08 15:15:55 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2012-08-08 15:15:55 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2012-08-08 15:15:55 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2012-08-08 15:15:55 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2012-08-08 15:15:55 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2012-08-08 15:15:55 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2012-08-08 15:15:55 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2012-08-08 15:15:55 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2012-08-08 15:15:56 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2012-08-08 15:15:56 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2012-08-08 15:15:56 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2012-08-08 15:15:56 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2012-08-08 15:15:56 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2012-08-08 15:15:56 [INFO    ] Setting Beam 3 xbars
2012-08-08 15:15:56 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2012-08-08 15:15:56 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2012-08-08 15:15:56 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2012-08-08 15:15:56 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2012-08-08 15:15:57 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2012-08-08 15:15:57 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2012-08-08 15:15:57 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2012-08-08 15:15:57 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2012-08-08 15:15:57 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2012-08-08 15:15:57 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2012-08-08 15:15:57 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2012-08-08 15:15:57 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2012-08-08 15:15:57 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2012-08-08 15:15:58 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2012-08-08 15:15:58 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2012-08-08 15:15:58 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2012-08-08 15:15:58 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2012-08-08 15:15:58 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2012-08-08 15:15:58 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2012-08-08 15:15:58 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2012-08-08 15:15:58 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2012-08-08 15:15:58 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2012-08-08 15:15:59 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2012-08-08 15:15:59 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2012-08-08 15:15:59 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2012-08-08 15:15:59 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2012-08-08 15:15:59 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2012-08-08 15:15:59 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2012-08-08 15:15:59 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2012-08-08 15:15:59 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2012-08-08 15:15:59 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2012-08-08 15:15:59 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2012-08-08 15:16:00 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2012-08-08 15:16:00 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2012-08-08 15:16:00 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2012-08-08 15:16:00 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2012-08-08 15:16:00 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2012-08-08 15:16:00 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2012-08-08 15:16:00 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2012-08-08 15:16:00 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2012-08-08 15:16:00 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2012-08-08 15:16:01 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2012-08-08 15:16:01 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2012-08-08 15:16:01 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2012-08-08 15:16:01 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2012-08-08 15:16:01 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2012-08-08 15:16:01 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2012-08-08 15:16:01 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2012-08-08 15:16:01 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2012-08-08 15:16:01 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2012-08-08 15:16:02 [INFO    ] Setting Beam 4 xbars
2012-08-08 15:16:02 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2012-08-08 15:16:02 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 15:16:02 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 15:16:02 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 15:16:02 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 15:16:02 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2012-08-08 15:16:02 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2012-08-08 15:16:02 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2012-08-08 15:16:02 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2012-08-08 15:16:03 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2012-08-08 15:16:03 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2012-08-08 15:16:03 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2012-08-08 15:16:03 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2012-08-08 15:16:03 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2012-08-08 15:16:03 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2012-08-08 15:16:03 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2012-08-08 15:16:03 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2012-08-08 15:16:03 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2012-08-08 15:16:04 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2012-08-08 15:16:04 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2012-08-08 15:16:04 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2012-08-08 15:16:04 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2012-08-08 15:16:04 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2012-08-08 15:16:04 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2012-08-08 15:16:04 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2012-08-08 15:16:04 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2012-08-08 15:16:04 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2012-08-08 15:16:04 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2012-08-08 15:16:05 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2012-08-08 15:16:05 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2012-08-08 15:16:05 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2012-08-08 15:16:05 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2012-08-08 15:16:05 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2012-08-08 15:16:05 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2012-08-08 15:16:05 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2012-08-08 15:16:05 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2012-08-08 15:16:05 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2012-08-08 15:16:06 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2012-08-08 15:16:06 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2012-08-08 15:16:06 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2012-08-08 15:16:06 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2012-08-08 15:16:06 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2012-08-08 15:16:06 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2012-08-08 15:16:06 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2012-08-08 15:16:06 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2012-08-08 15:16:06 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2012-08-08 15:16:07 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2012-08-08 15:16:07 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2012-08-08 15:16:07 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2012-08-08 15:16:07 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2012-08-08 15:16:07 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2012-08-08 15:16:07 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2012-08-08 15:16:07 [INFO    ] All xbars set
2012-08-08 15:16:07 [INFO    ] Setting adder chain routing for all beams
2012-08-08 15:16:12 [INFO    ] Setting beam ids
2012-08-08 15:16:22 [INFO    ] Starting beam delay calibration
2012-08-08 15:16:34 [INFO    ] Beam 1 latency is 5750
2012-08-08 15:16:34 [INFO    ] Beam 2 latency is 5763
2012-08-08 15:16:34 [INFO    ] Beam 3 latency is 5765
2012-08-08 15:16:34 [INFO    ] Beam 4 latency is 5727
2012-08-08 15:16:34 [INFO    ] Stop calibration
2012-08-08 15:16:42 [INFO    ] Beam delay calibration successful
2012-08-08 15:16:42 [INFO    ] Calibration passed
2012-08-08 15:16:42 [DEBUG   ] spawn_process: at 2012-08-08 15:16:42 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2012-08-08 15:16:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2012-08-08 15:16:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2012-08-08 15:16:42 [DEBUG   ] spawn_process: at 2012-08-08 15:16:42 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2012-08-08 15:16:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2012-08-08 15:16:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2012-08-08 15:16:42 [DEBUG   ] spawn_process: at 2012-08-08 15:16:42 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2012-08-08 15:16:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2012-08-08 15:16:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2012-08-08 15:16:42 [DEBUG   ] spawn_process: at 2012-08-08 15:16:42 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2012-08-08 15:16:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2012-08-08 15:16:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2012-08-08 15:16:43 [DEBUG   ] Finished updating ant stats in 0.543 seconds
2012-08-08 15:16:43 [INFO    ] Started antennas statistics background thread
2012-08-08 15:16:43 [INFO    ] Started board flags background thread
2012-08-08 15:16:43 [INFO    ] Started BAM background thread
2012-08-08 15:16:43 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 with PID 16807
2012-08-08 15:16:43 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 with PID 16810
2012-08-08 15:16:43 [INFO    ] Finished the INI process in 103.435 s
2012-08-08 15:16:44 [DEBUG   ] Finished updating board flags in 0.821 seconds
2012-08-08 15:17:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-08 15:17:23 [DEBUG   ] Finished updating ant stats in 0.391 seconds
2012-08-08 15:17:44 [DEBUG   ] Finished updating ant stats in 1.228 seconds
2012-08-08 15:17:44 [DEBUG   ] Finished updating board flags in 0.890 seconds
2012-08-08 15:18:04 [DEBUG   ] Finished updating ant stats in 1.178 seconds
2012-08-08 15:18:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-08 15:18:44 [DEBUG   ] Finished updating ant stats in 1.027 seconds
2012-08-08 15:18:44 [DEBUG   ] Finished updating board flags in 1.079 seconds
2012-08-08 15:19:00 [DEBUG   ] Got command TBN from MCS: ref #6086
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '1', '1344439142']
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '2', '1344439142']
2012-08-08 15:19:00 [DEBUG   ] tbn = exited with status True, code 0x00
2012-08-08 15:19:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN     6086   8 56147 55140525 A NORMAL'
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '3', '1344439142']
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '4', '1344439142']
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '5', '1344439142']
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '6', '1344439142']
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '7', '1344439142']
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '8', '1344439142']
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '9', '1344439142']
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '10', '1344439142']
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '11', '1344439142']
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '12', '1344439142']
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '13', '1344439142']
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '14', '1344439142']
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '15', '1344439142']
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '16', '1344439142']
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '17', '1344439142']
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '18', '1344439142']
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '19', '1344439142']
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '20', '1344439142']
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '21', '1344439142']
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '22', '1344439142']
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '23', '1344439142']
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '24', '1344439142']
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '25', '1344439142']
2012-08-08 15:19:00 [DEBUG   ] spawn_process: at 2012-08-08 15:19:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '17', '0', '26', '1344439142']
2012-08-08 15:19:00 [INFO    ] Finished spawning TBN in 0.047 s
2012-08-08 15:19:04 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2012-08-08 15:19:06 [DEBUG   ] Got command RPT from MCS: ref #6087
2012-08-08 15:19:06 [DEBUG   ] summary = NORMAL
2012-08-08 15:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6087  14 56147 55146152 A NORMALNORMAL'
2012-08-08 15:19:06 [DEBUG   ] Got command RPT from MCS: ref #6088
2012-08-08 15:19:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 15:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6088  48 56147 55146153 A NORMALSystem calibrated and operating normally'
2012-08-08 15:19:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 15:19:44 [DEBUG   ] Finished updating ant stats in 1.041 seconds
2012-08-08 15:19:45 [DEBUG   ] Finished updating board flags in 1.271 seconds
2012-08-08 15:20:04 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2012-08-08 15:20:11 [DEBUG   ] Got command INI from MCS: ref #6104
2012-08-08 15:20:11 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2012-08-08 15:20:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI     6104   8 56147 55211853 ABOOTING'
2012-08-08 15:20:31 [INFO    ] -------------------
2012-08-08 15:20:31 [INFO    ]  LWA board status
2012-08-08 15:20:31 [INFO    ] -------------------
2012-08-08 15:20:31 [INFO    ] DP 1: 2 lwa27
2012-08-08 15:20:31 [INFO    ] DP 1: 3 lwa24
2012-08-08 15:20:31 [INFO    ] DP 1: 4 lwa23
2012-08-08 15:20:31 [INFO    ] DP 1: 5 lwa18
2012-08-08 15:20:31 [INFO    ] DP 1: 6 lwa10
2012-08-08 15:20:31 [INFO    ] DP 1: 7 lwa32
2012-08-08 15:20:31 [INFO    ] DP 1: 8 lwa11
2012-08-08 15:20:31 [INFO    ] DP 1: 9 lwa30
2012-08-08 15:20:31 [INFO    ] DP 1: 10 lwa12
2012-08-08 15:20:31 [INFO    ] DP 1: 11 lwa8
2012-08-08 15:20:31 [INFO    ] DP 1: 12 lwa13
2012-08-08 15:20:31 [INFO    ] DP 1: 13 lwa26
2012-08-08 15:20:31 [INFO    ] DP 1: 14 lwa14
2012-08-08 15:20:31 [INFO    ] DP 1: 16 lwa22
2012-08-08 15:20:31 [INFO    ] DP 1: 17 lwa20
2012-08-08 15:20:31 [INFO    ] DP 1: 18 lwa1
2012-08-08 15:20:31 [INFO    ] DP 1: 19 lwa5
2012-08-08 15:20:31 [INFO    ] DP 1: 20 lwa25
2012-08-08 15:20:31 [INFO    ] DP 1: 21 lwa35
2012-08-08 15:20:31 [INFO    ] DP 1: 22 lwa19
2012-08-08 15:20:31 [INFO    ] DP 1: 23 lwa21
2012-08-08 15:20:31 [INFO    ] DP 1: 24 lwa6
2012-08-08 15:20:31 [INFO    ] DP 1: 25 lwa7
2012-08-08 15:20:31 [INFO    ] DP 1: 26 lwa33
2012-08-08 15:20:31 [INFO    ] DP 1: 27 lwa15
2012-08-08 15:20:31 [INFO    ] DP 1: 28 lwa28
2012-08-08 15:20:31 [INFO    ] DP 2: 1 lwa16
2012-08-08 15:20:31 [INFO    ] DP 2: 15 lwa34
2012-08-08 15:20:31 [INFO    ] Total of 28 boards
2012-08-08 15:20:31 [INFO    ] Total of 260 stands
2012-08-08 15:20:31 [INFO    ] -------------------
2012-08-08 15:20:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:35 [DEBUG   ] Got command RPT from MCS: ref #6105
2012-08-08 15:20:35 [DEBUG   ] summary = BOOTING
2012-08-08 15:20:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6105  15 56147 55235753 ABOOTINGBOOTING'
2012-08-08 15:20:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17531
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17532
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17533
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17534
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17535
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17536
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17537
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17538
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17539
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17540
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17541
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17542
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17543
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17544
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17545
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17546
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17547
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17548
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17549
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17550
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17551
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17552
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17553
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17554
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17555
2012-08-08 15:20:38 [DEBUG   ] 2012-08-08 15:20:38 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 17556
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17531 exited with status 0
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17532 exited with status 0
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17533 exited with status 0
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17534 exited with status 0
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17535 exited with status 0
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17536 exited with status 0
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17537 exited with status 0
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17538 exited with status 0
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17539 exited with status 0
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17540 exited with status 0
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17541 exited with status 0
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17542 exited with status 0
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17543 exited with status 0
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17544 exited with status 0
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17545 exited with status 0
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17546 exited with status 0
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17547 exited with status 0
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17548 exited with status 0
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17549 exited with status 0
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17550 exited with status 0
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17551 exited with status 0
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17552 exited with status 0
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17553 exited with status 0
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17554 exited with status 0
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17555 exited with status 0
2012-08-08 15:20:50 [DEBUG   ] 2012-08-08 15:20:50 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 17556 exited with status 0
2012-08-08 15:20:50 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2012-08-08 15:20:50 [DEBUG   ] spawn_process: at 2012-08-08 15:20:50 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] spawn_process: at 2012-08-08 15:20:51 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] spawn_process: at 2012-08-08 15:20:51 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] spawn_process: at 2012-08-08 15:20:51 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] spawn_process: at 2012-08-08 15:20:51 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] spawn_process: at 2012-08-08 15:20:51 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] spawn_process: at 2012-08-08 15:20:51 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] spawn_process: at 2012-08-08 15:20:51 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] spawn_process: at 2012-08-08 15:20:51 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] spawn_process: at 2012-08-08 15:20:51 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] spawn_process: at 2012-08-08 15:20:51 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] spawn_process: at 2012-08-08 15:20:51 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] spawn_process: at 2012-08-08 15:20:51 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] spawn_process: at 2012-08-08 15:20:51 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] spawn_process: at 2012-08-08 15:20:51 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] spawn_process: at 2012-08-08 15:20:51 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] spawn_process: at 2012-08-08 15:20:51 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] spawn_process: at 2012-08-08 15:20:51 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] spawn_process: at 2012-08-08 15:20:51 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] spawn_process: at 2012-08-08 15:20:51 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] spawn_process: at 2012-08-08 15:20:51 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] spawn_process: at 2012-08-08 15:20:51 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] spawn_process: at 2012-08-08 15:20:51 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] spawn_process: at 2012-08-08 15:20:51 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] spawn_process: at 2012-08-08 15:20:51 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] spawn_process: at 2012-08-08 15:20:51 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2012-08-08 15:20:51 [DEBUG   ] 2012-08-08 15:20:51 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 17583
2012-08-08 15:20:51 [DEBUG   ] 2012-08-08 15:20:51 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 17584
2012-08-08 15:20:56 [DEBUG   ] 2012-08-08 15:20:56 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 17583 exited with status 0
2012-08-08 15:20:56 [DEBUG   ] 2012-08-08 15:20:56 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 17584 exited with status 0
2012-08-08 15:20:56 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2012-08-08 15:20:56 [DEBUG   ] spawn_process: at 2012-08-08 15:20:56 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2012-08-08 15:20:56 [DEBUG   ] spawn_process: at 2012-08-08 15:20:56 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2012-08-08 15:20:56 [INFO    ] Setting Beam 1 xbars
2012-08-08 15:20:56 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2012-08-08 15:20:56 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2012-08-08 15:20:56 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2012-08-08 15:20:56 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2012-08-08 15:20:57 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2012-08-08 15:20:57 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2012-08-08 15:20:57 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2012-08-08 15:20:57 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2012-08-08 15:20:57 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2012-08-08 15:20:57 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2012-08-08 15:20:57 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2012-08-08 15:20:57 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2012-08-08 15:20:57 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2012-08-08 15:20:58 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2012-08-08 15:20:58 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2012-08-08 15:20:58 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2012-08-08 15:20:58 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2012-08-08 15:20:58 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2012-08-08 15:20:58 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2012-08-08 15:20:58 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2012-08-08 15:20:58 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2012-08-08 15:20:58 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2012-08-08 15:20:59 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2012-08-08 15:20:59 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2012-08-08 15:20:59 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2012-08-08 15:20:59 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2012-08-08 15:20:59 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2012-08-08 15:20:59 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2012-08-08 15:20:59 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2012-08-08 15:20:59 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2012-08-08 15:20:59 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2012-08-08 15:21:00 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2012-08-08 15:21:00 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2012-08-08 15:21:00 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2012-08-08 15:21:00 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2012-08-08 15:21:00 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2012-08-08 15:21:00 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2012-08-08 15:21:00 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2012-08-08 15:21:00 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2012-08-08 15:21:00 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2012-08-08 15:21:01 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2012-08-08 15:21:01 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2012-08-08 15:21:01 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2012-08-08 15:21:01 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2012-08-08 15:21:01 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2012-08-08 15:21:01 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2012-08-08 15:21:01 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2012-08-08 15:21:01 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2012-08-08 15:21:01 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2012-08-08 15:21:01 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2012-08-08 15:21:02 [INFO    ] Setting Beam 2 xbars
2012-08-08 15:21:02 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2012-08-08 15:21:02 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2012-08-08 15:21:02 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2012-08-08 15:21:02 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2012-08-08 15:21:02 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2012-08-08 15:21:02 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2012-08-08 15:21:02 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2012-08-08 15:21:02 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2012-08-08 15:21:02 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2012-08-08 15:21:03 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2012-08-08 15:21:03 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2012-08-08 15:21:03 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2012-08-08 15:21:03 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2012-08-08 15:21:03 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2012-08-08 15:21:03 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2012-08-08 15:21:03 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2012-08-08 15:21:03 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2012-08-08 15:21:03 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2012-08-08 15:21:04 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2012-08-08 15:21:04 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2012-08-08 15:21:04 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2012-08-08 15:21:04 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2012-08-08 15:21:04 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2012-08-08 15:21:04 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2012-08-08 15:21:04 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2012-08-08 15:21:04 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2012-08-08 15:21:04 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2012-08-08 15:21:05 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2012-08-08 15:21:05 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2012-08-08 15:21:05 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2012-08-08 15:21:05 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2012-08-08 15:21:05 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2012-08-08 15:21:05 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2012-08-08 15:21:05 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2012-08-08 15:21:05 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2012-08-08 15:21:05 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2012-08-08 15:21:06 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2012-08-08 15:21:06 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2012-08-08 15:21:06 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2012-08-08 15:21:06 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2012-08-08 15:21:06 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2012-08-08 15:21:06 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2012-08-08 15:21:06 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2012-08-08 15:21:06 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2012-08-08 15:21:06 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2012-08-08 15:21:07 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2012-08-08 15:21:07 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2012-08-08 15:21:07 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2012-08-08 15:21:07 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2012-08-08 15:21:07 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2012-08-08 15:21:07 [INFO    ] Setting Beam 3 xbars
2012-08-08 15:21:07 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2012-08-08 15:21:07 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2012-08-08 15:21:07 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2012-08-08 15:21:07 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2012-08-08 15:21:08 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2012-08-08 15:21:08 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2012-08-08 15:21:08 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2012-08-08 15:21:08 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2012-08-08 15:21:08 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2012-08-08 15:21:08 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2012-08-08 15:21:08 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2012-08-08 15:21:08 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2012-08-08 15:21:08 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2012-08-08 15:21:09 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2012-08-08 15:21:09 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2012-08-08 15:21:09 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2012-08-08 15:21:09 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2012-08-08 15:21:09 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2012-08-08 15:21:09 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2012-08-08 15:21:09 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2012-08-08 15:21:09 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2012-08-08 15:21:09 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2012-08-08 15:21:10 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2012-08-08 15:21:10 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2012-08-08 15:21:10 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2012-08-08 15:21:10 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2012-08-08 15:21:10 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2012-08-08 15:21:10 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2012-08-08 15:21:10 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2012-08-08 15:21:10 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2012-08-08 15:21:10 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2012-08-08 15:21:11 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2012-08-08 15:21:11 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2012-08-08 15:21:11 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2012-08-08 15:21:11 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2012-08-08 15:21:11 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2012-08-08 15:21:11 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2012-08-08 15:21:11 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2012-08-08 15:21:11 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2012-08-08 15:21:11 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2012-08-08 15:21:12 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2012-08-08 15:21:12 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2012-08-08 15:21:12 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2012-08-08 15:21:12 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2012-08-08 15:21:12 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2012-08-08 15:21:12 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2012-08-08 15:21:12 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2012-08-08 15:21:12 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2012-08-08 15:21:12 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2012-08-08 15:21:13 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2012-08-08 15:21:13 [INFO    ] Setting Beam 4 xbars
2012-08-08 15:21:13 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2012-08-08 15:21:13 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 15:21:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 15:21:13 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 15:21:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 15:21:13 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2012-08-08 15:21:13 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2012-08-08 15:21:13 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2012-08-08 15:21:13 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2012-08-08 15:21:14 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2012-08-08 15:21:14 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2012-08-08 15:21:14 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2012-08-08 15:21:14 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2012-08-08 15:21:14 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2012-08-08 15:21:14 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2012-08-08 15:21:14 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2012-08-08 15:21:14 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2012-08-08 15:21:14 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2012-08-08 15:21:15 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2012-08-08 15:21:15 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2012-08-08 15:21:15 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2012-08-08 15:21:15 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2012-08-08 15:21:15 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2012-08-08 15:21:15 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2012-08-08 15:21:15 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2012-08-08 15:21:15 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2012-08-08 15:21:15 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2012-08-08 15:21:16 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2012-08-08 15:21:16 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2012-08-08 15:21:16 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2012-08-08 15:21:16 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2012-08-08 15:21:16 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2012-08-08 15:21:16 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2012-08-08 15:21:16 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2012-08-08 15:21:16 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2012-08-08 15:21:16 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2012-08-08 15:21:17 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2012-08-08 15:21:17 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2012-08-08 15:21:17 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2012-08-08 15:21:17 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2012-08-08 15:21:17 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2012-08-08 15:21:17 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2012-08-08 15:21:17 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2012-08-08 15:21:17 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2012-08-08 15:21:17 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2012-08-08 15:21:18 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2012-08-08 15:21:18 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2012-08-08 15:21:18 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2012-08-08 15:21:18 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2012-08-08 15:21:18 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2012-08-08 15:21:18 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2012-08-08 15:21:18 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2012-08-08 15:21:18 [INFO    ] All xbars set
2012-08-08 15:21:18 [INFO    ] Setting adder chain routing for all beams
2012-08-08 15:21:23 [INFO    ] Setting beam ids
2012-08-08 15:21:33 [INFO    ] Starting beam delay calibration
2012-08-08 15:21:36 [DEBUG   ] Got command RPT from MCS: ref #6106
2012-08-08 15:21:36 [DEBUG   ] summary = BOOTING
2012-08-08 15:21:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6106  15 56147 55296661 ABOOTINGBOOTING'
2012-08-08 15:21:45 [INFO    ] Beam 1 latency is 5722
2012-08-08 15:21:45 [INFO    ] Beam 2 latency is 5750
2012-08-08 15:21:45 [INFO    ] Beam 3 latency is 5745
2012-08-08 15:21:45 [INFO    ] Beam 4 latency is 5721
2012-08-08 15:21:45 [INFO    ] Stop calibration
2012-08-08 15:21:53 [INFO    ] Beam delay calibration successful
2012-08-08 15:21:53 [INFO    ] Calibration passed
2012-08-08 15:21:53 [DEBUG   ] spawn_process: at 2012-08-08 15:21:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2012-08-08 15:21:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2012-08-08 15:21:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2012-08-08 15:21:53 [DEBUG   ] spawn_process: at 2012-08-08 15:21:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2012-08-08 15:21:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2012-08-08 15:21:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2012-08-08 15:21:53 [DEBUG   ] spawn_process: at 2012-08-08 15:21:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2012-08-08 15:21:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2012-08-08 15:21:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2012-08-08 15:21:53 [DEBUG   ] spawn_process: at 2012-08-08 15:21:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2012-08-08 15:21:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2012-08-08 15:21:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2012-08-08 15:21:54 [DEBUG   ] Finished updating ant stats in 0.438 seconds
2012-08-08 15:21:54 [INFO    ] Started antennas statistics background thread
2012-08-08 15:21:54 [INFO    ] Started board flags background thread
2012-08-08 15:21:54 [INFO    ] Started BAM background thread
2012-08-08 15:21:54 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 with PID 19178
2012-08-08 15:21:54 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 with PID 19181
2012-08-08 15:21:55 [INFO    ] Finished the INI process in 103.193 s
2012-08-08 15:21:55 [DEBUG   ] Finished updating board flags in 0.824 seconds
2012-08-08 15:22:06 [DEBUG   ] Got command RPT from MCS: ref #6107
2012-08-08 15:22:06 [DEBUG   ] summary = NORMAL
2012-08-08 15:22:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6107  14 56147 55326348 A NORMALNORMAL'
2012-08-08 15:22:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-08 15:22:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-08 15:22:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 15:22:55 [DEBUG   ] Finished updating board flags in 0.824 seconds
2012-08-08 15:23:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-08 15:23:30 [DEBUG   ] Got command TBN from MCS: ref #6108
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '1', '1344439411']
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '2', '1344439411']
2012-08-08 15:23:30 [DEBUG   ] tbn = exited with status True, code 0x00
2012-08-08 15:23:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN     6108   8 56147 55410105 A NORMAL'
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '3', '1344439411']
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '4', '1344439411']
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '5', '1344439411']
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '6', '1344439411']
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '7', '1344439411']
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '8', '1344439411']
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '9', '1344439411']
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '10', '1344439411']
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '11', '1344439411']
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '12', '1344439411']
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '13', '1344439411']
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '14', '1344439411']
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '15', '1344439411']
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '16', '1344439411']
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '17', '1344439411']
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '18', '1344439411']
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '19', '1344439411']
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '20', '1344439411']
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '21', '1344439411']
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '22', '1344439411']
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '23', '1344439411']
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '24', '1344439411']
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '25', '1344439411']
2012-08-08 15:23:30 [DEBUG   ] spawn_process: at 2012-08-08 15:23:30 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '74030000.0', '7', '20', '0', '26', '1344439411']
2012-08-08 15:23:30 [INFO    ] Finished spawning TBN in 0.047 s
2012-08-08 15:23:34 [DEBUG   ] Finished updating ant stats in 0.474 seconds
2012-08-08 15:23:55 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-08 15:23:56 [DEBUG   ] Finished updating board flags in 1.255 seconds
2012-08-08 15:24:06 [DEBUG   ] Got command RPT from MCS: ref #6109
2012-08-08 15:24:06 [DEBUG   ] summary = NORMAL
2012-08-08 15:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6109  14 56147 55446169 A NORMALNORMAL'
2012-08-08 15:24:06 [DEBUG   ] Got command RPT from MCS: ref #6110
2012-08-08 15:24:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 15:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6110  48 56147 55446169 A NORMALSystem calibrated and operating normally'
2012-08-08 15:24:15 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2012-08-08 15:24:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 15:24:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 15:24:55 [DEBUG   ] Finished updating ant stats in 1.241 seconds
2012-08-08 15:24:56 [DEBUG   ] Finished updating board flags in 1.265 seconds
2012-08-08 15:25:15 [DEBUG   ] Finished updating ant stats in 1.160 seconds
2012-08-08 15:25:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 15:25:55 [DEBUG   ] Finished updating ant stats in 1.042 seconds
2012-08-08 15:25:56 [DEBUG   ] Finished updating board flags in 1.275 seconds
2012-08-08 15:26:15 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2012-08-08 15:26:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 15:26:55 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2012-08-08 15:26:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2012-08-08 15:26:56 [CRITICAL] MGT underflow detected on beam(s) 1
2012-08-08 15:26:56 [DEBUG   ] Finished updating board flags in 1.272 seconds
2012-08-08 15:27:15 [DEBUG   ] Finished updating ant stats in 0.761 seconds
2012-08-08 15:27:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-08 15:27:55 [DEBUG   ] Finished updating ant stats in 0.445 seconds
2012-08-08 15:27:56 [DEBUG   ] Finished updating board flags in 1.240 seconds
2012-08-08 15:28:16 [DEBUG   ] Finished updating ant stats in 1.359 seconds
2012-08-08 15:28:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 15:28:56 [DEBUG   ] Finished updating ant stats in 1.241 seconds
2012-08-08 15:28:56 [DEBUG   ] Finished updating board flags in 1.297 seconds
2012-08-08 15:29:06 [DEBUG   ] Got command RPT from MCS: ref #6126
2012-08-08 15:29:06 [DEBUG   ] summary = ERROR
2012-08-08 15:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6126  13 56147 55746157 A  ERRORERROR'
2012-08-08 15:29:06 [DEBUG   ] Got command RPT from MCS: ref #6127
2012-08-08 15:29:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 15:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6127  77 56147 55746157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 15:29:16 [DEBUG   ] Finished updating ant stats in 1.165 seconds
2012-08-08 15:29:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 15:29:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 15:29:56 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2012-08-08 15:29:57 [DEBUG   ] Finished updating board flags in 1.971 seconds
2012-08-08 15:30:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 15:30:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 15:30:56 [DEBUG   ] Finished updating ant stats in 0.638 seconds
2012-08-08 15:30:56 [DEBUG   ] Finished updating board flags in 1.363 seconds
2012-08-08 15:31:16 [DEBUG   ] Finished updating ant stats in 0.563 seconds
2012-08-08 15:31:37 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2012-08-08 15:31:56 [DEBUG   ] Finished updating board flags in 1.286 seconds
2012-08-08 15:31:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 15:32:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-08 15:32:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 15:32:57 [DEBUG   ] Finished updating board flags in 1.506 seconds
2012-08-08 15:32:57 [DEBUG   ] Finished updating ant stats in 0.838 seconds
2012-08-08 15:33:17 [DEBUG   ] Finished updating ant stats in 0.768 seconds
2012-08-08 15:33:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-08 15:33:57 [DEBUG   ] Finished updating board flags in 1.377 seconds
2012-08-08 15:33:58 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-08 15:34:06 [DEBUG   ] Got command RPT from MCS: ref #6143
2012-08-08 15:34:06 [DEBUG   ] summary = ERROR
2012-08-08 15:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6143  13 56147 56046157 A  ERRORERROR'
2012-08-08 15:34:06 [DEBUG   ] Got command RPT from MCS: ref #6144
2012-08-08 15:34:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 15:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6144  77 56147 56046157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 15:34:18 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-08 15:34:38 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-08 15:34:58 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-08 15:34:58 [DEBUG   ] Finished updating board flags in 2.413 seconds
2012-08-08 15:35:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 15:35:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 15:35:57 [DEBUG   ] Finished updating board flags in 1.296 seconds
2012-08-08 15:35:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-08 15:36:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 15:36:38 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-08 15:36:57 [DEBUG   ] Finished updating board flags in 1.281 seconds
2012-08-08 15:36:58 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 15:37:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 15:37:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 15:37:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 15:37:57 [DEBUG   ] Finished updating board flags in 1.287 seconds
2012-08-08 15:37:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 15:38:18 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 15:38:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 15:38:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2012-08-08 15:38:57 [DEBUG   ] Finished updating board flags in 1.280 seconds
2012-08-08 15:38:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 15:39:06 [DEBUG   ] Got command RPT from MCS: ref #6160
2012-08-08 15:39:06 [DEBUG   ] summary = ERROR
2012-08-08 15:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6160  13 56147 56346161 A  ERRORERROR'
2012-08-08 15:39:06 [DEBUG   ] Got command RPT from MCS: ref #6161
2012-08-08 15:39:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 15:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6161  77 56147 56346161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 15:39:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 15:39:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 15:39:57 [DEBUG   ] Finished updating board flags in 1.563 seconds
2012-08-08 15:39:58 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2012-08-08 15:40:19 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-08 15:40:39 [DEBUG   ] Finished updating ant stats in 1.191 seconds
2012-08-08 15:40:57 [DEBUG   ] Finished updating board flags in 1.415 seconds
2012-08-08 15:40:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 15:41:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 15:41:39 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-08 15:41:57 [DEBUG   ] Finished updating board flags in 1.227 seconds
2012-08-08 15:41:59 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2012-08-08 15:42:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 15:42:39 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-08 15:42:57 [DEBUG   ] Finished updating board flags in 1.234 seconds
2012-08-08 15:42:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 15:43:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 15:43:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 15:43:57 [DEBUG   ] Finished updating board flags in 1.234 seconds
2012-08-08 15:43:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 15:44:06 [DEBUG   ] Got command RPT from MCS: ref #6177
2012-08-08 15:44:06 [DEBUG   ] summary = ERROR
2012-08-08 15:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6177  13 56147 56646161 A  ERRORERROR'
2012-08-08 15:44:06 [DEBUG   ] Got command RPT from MCS: ref #6178
2012-08-08 15:44:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 15:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6178  77 56147 56646161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 15:44:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 15:44:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-08 15:44:57 [DEBUG   ] Finished updating board flags in 1.239 seconds
2012-08-08 15:45:00 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-08 15:45:20 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-08 15:45:40 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-08 15:45:57 [DEBUG   ] Finished updating board flags in 1.233 seconds
2012-08-08 15:46:00 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-08 15:46:20 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-08 15:46:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 15:46:57 [DEBUG   ] Finished updating board flags in 1.240 seconds
2012-08-08 15:47:00 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 15:47:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 15:47:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 15:47:58 [DEBUG   ] Finished updating board flags in 1.428 seconds
2012-08-08 15:48:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 15:48:20 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2012-08-08 15:48:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 15:48:58 [DEBUG   ] Finished updating board flags in 1.422 seconds
2012-08-08 15:49:00 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-08 15:49:06 [DEBUG   ] Got command RPT from MCS: ref #6194
2012-08-08 15:49:06 [DEBUG   ] summary = ERROR
2012-08-08 15:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6194  13 56147 56946168 A  ERRORERROR'
2012-08-08 15:49:06 [DEBUG   ] Got command RPT from MCS: ref #6195
2012-08-08 15:49:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 15:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6195  77 56147 56946169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 15:49:20 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 15:49:40 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-08 15:49:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 15:49:58 [DEBUG   ] Finished updating board flags in 1.408 seconds
2012-08-08 15:50:01 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2012-08-08 15:50:21 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-08 15:50:41 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-08 15:50:58 [DEBUG   ] Finished updating board flags in 1.410 seconds
2012-08-08 15:51:01 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-08 15:51:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 15:51:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 15:51:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-08 15:51:58 [DEBUG   ] Finished updating board flags in 1.378 seconds
2012-08-08 15:52:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 15:52:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 15:52:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 15:52:58 [DEBUG   ] Finished updating board flags in 1.272 seconds
2012-08-08 15:53:01 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 15:53:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-08 15:53:41 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-08 15:53:58 [DEBUG   ] Finished updating board flags in 1.273 seconds
2012-08-08 15:54:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 15:54:06 [DEBUG   ] Got command RPT from MCS: ref #6211
2012-08-08 15:54:06 [DEBUG   ] summary = ERROR
2012-08-08 15:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6211  13 56147 57246160 A  ERRORERROR'
2012-08-08 15:54:06 [DEBUG   ] Got command RPT from MCS: ref #6212
2012-08-08 15:54:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 15:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6212  77 56147 57246161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 15:54:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 15:54:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 15:54:58 [DEBUG   ] Finished updating board flags in 1.263 seconds
2012-08-08 15:55:01 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2012-08-08 15:55:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 15:55:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 15:55:58 [DEBUG   ] Finished updating board flags in 1.282 seconds
2012-08-08 15:56:01 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 15:56:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 15:56:41 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-08 15:56:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 15:56:58 [DEBUG   ] Finished updating board flags in 1.280 seconds
2012-08-08 15:57:01 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 15:57:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-08 15:57:42 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-08 15:57:58 [DEBUG   ] Finished updating board flags in 1.277 seconds
2012-08-08 15:58:02 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-08 15:58:22 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-08 15:58:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 15:58:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 15:58:58 [DEBUG   ] Finished updating board flags in 1.432 seconds
2012-08-08 15:59:02 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-08 15:59:06 [DEBUG   ] Got command RPT from MCS: ref #6228
2012-08-08 15:59:06 [DEBUG   ] summary = ERROR
2012-08-08 15:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6228  13 56147 57546160 A  ERRORERROR'
2012-08-08 15:59:06 [DEBUG   ] Got command RPT from MCS: ref #6229
2012-08-08 15:59:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 15:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6229  77 56147 57546161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 15:59:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 15:59:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 15:59:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 15:59:58 [DEBUG   ] Finished updating board flags in 1.325 seconds
2012-08-08 16:00:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 16:00:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 16:00:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 16:00:58 [DEBUG   ] Finished updating board flags in 1.328 seconds
2012-08-08 16:01:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 16:01:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 16:01:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 16:01:59 [DEBUG   ] Finished updating board flags in 1.532 seconds
2012-08-08 16:02:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 16:02:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 16:02:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 16:02:59 [DEBUG   ] Finished updating board flags in 1.425 seconds
2012-08-08 16:03:02 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-08 16:03:22 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 16:03:43 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2012-08-08 16:03:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 16:03:59 [DEBUG   ] Finished updating board flags in 1.246 seconds
2012-08-08 16:04:03 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-08 16:04:06 [DEBUG   ] Got command RPT from MCS: ref #6245
2012-08-08 16:04:06 [DEBUG   ] summary = ERROR
2012-08-08 16:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6245  13 56147 57846164 A  ERRORERROR'
2012-08-08 16:04:06 [DEBUG   ] Got command RPT from MCS: ref #6246
2012-08-08 16:04:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 16:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6246  77 56147 57846165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 16:04:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-08 16:04:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 16:04:59 [DEBUG   ] Finished updating board flags in 1.402 seconds
2012-08-08 16:05:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-08 16:05:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 16:05:43 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-08 16:05:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 16:05:59 [DEBUG   ] Finished updating board flags in 1.229 seconds
2012-08-08 16:06:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 16:06:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 16:06:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 16:06:59 [DEBUG   ] Finished updating board flags in 1.259 seconds
2012-08-08 16:07:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 16:07:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-08 16:07:44 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-08 16:07:59 [DEBUG   ] Finished updating board flags in 1.245 seconds
2012-08-08 16:08:04 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-08 16:08:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 16:08:44 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-08 16:08:59 [DEBUG   ] Finished updating board flags in 1.258 seconds
2012-08-08 16:09:04 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-08 16:09:06 [DEBUG   ] Got command RPT from MCS: ref #6262
2012-08-08 16:09:06 [DEBUG   ] summary = ERROR
2012-08-08 16:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6262  13 56147 58146165 A  ERRORERROR'
2012-08-08 16:09:06 [DEBUG   ] Got command RPT from MCS: ref #6263
2012-08-08 16:09:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 16:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6263  77 56147 58146165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 16:09:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 16:09:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 16:09:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 16:09:59 [DEBUG   ] Finished updating board flags in 1.250 seconds
2012-08-08 16:10:04 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-08 16:10:24 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2012-08-08 16:10:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 16:10:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 16:10:59 [DEBUG   ] Finished updating board flags in 1.249 seconds
2012-08-08 16:11:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 16:11:24 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-08 16:11:44 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 16:11:59 [DEBUG   ] Finished updating board flags in 1.274 seconds
2012-08-08 16:12:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 16:12:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 16:12:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 16:12:59 [DEBUG   ] Finished updating board flags in 1.272 seconds
2012-08-08 16:13:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 16:13:25 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-08 16:13:45 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2012-08-08 16:13:59 [DEBUG   ] Finished updating board flags in 1.454 seconds
2012-08-08 16:14:05 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2012-08-08 16:14:06 [DEBUG   ] Got command RPT from MCS: ref #6279
2012-08-08 16:14:06 [DEBUG   ] summary = ERROR
2012-08-08 16:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6279  13 56147 58446173 A  ERRORERROR'
2012-08-08 16:14:06 [DEBUG   ] Got command RPT from MCS: ref #6280
2012-08-08 16:14:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 16:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6280  77 56147 58446173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 16:14:25 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-08 16:14:45 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-08 16:14:59 [DEBUG   ] Finished updating board flags in 1.329 seconds
2012-08-08 16:15:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 16:15:25 [DEBUG   ] Finished updating ant stats in 0.792 seconds
2012-08-08 16:15:45 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2012-08-08 16:15:59 [DEBUG   ] Finished updating board flags in 1.246 seconds
2012-08-08 16:16:06 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-08 16:16:25 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-08 16:16:46 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2012-08-08 16:16:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 16:16:59 [DEBUG   ] Finished updating board flags in 1.235 seconds
2012-08-08 16:17:06 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-08 16:17:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 16:17:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 16:17:59 [DEBUG   ] Finished updating board flags in 1.248 seconds
2012-08-08 16:18:06 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-08 16:18:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 16:18:46 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-08 16:18:59 [DEBUG   ] Finished updating board flags in 1.229 seconds
2012-08-08 16:19:06 [DEBUG   ] Got command RPT from MCS: ref #6296
2012-08-08 16:19:06 [DEBUG   ] summary = ERROR
2012-08-08 16:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6296  13 56147 58746165 A  ERRORERROR'
2012-08-08 16:19:06 [DEBUG   ] Got command RPT from MCS: ref #6297
2012-08-08 16:19:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 16:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6297  77 56147 58746165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 16:19:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 16:19:26 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2012-08-08 16:19:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 16:20:00 [DEBUG   ] Finished updating board flags in 1.434 seconds
2012-08-08 16:20:06 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-08 16:20:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 16:20:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 16:21:00 [DEBUG   ] Finished updating board flags in 1.424 seconds
2012-08-08 16:21:07 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-08 16:21:26 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-08 16:21:46 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 16:22:00 [DEBUG   ] Finished updating board flags in 1.396 seconds
2012-08-08 16:22:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 16:22:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 16:22:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-08 16:23:00 [DEBUG   ] Finished updating board flags in 1.271 seconds
2012-08-08 16:23:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 16:23:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 16:23:47 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-08 16:24:00 [DEBUG   ] Finished updating board flags in 1.269 seconds
2012-08-08 16:24:06 [DEBUG   ] Got command RPT from MCS: ref #6313
2012-08-08 16:24:06 [DEBUG   ] summary = ERROR
2012-08-08 16:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6313  13 56147 59046173 A  ERRORERROR'
2012-08-08 16:24:06 [DEBUG   ] Got command RPT from MCS: ref #6314
2012-08-08 16:24:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 16:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6314  77 56147 59046173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 16:24:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 16:24:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 16:24:47 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-08 16:25:00 [DEBUG   ] Finished updating board flags in 1.284 seconds
2012-08-08 16:25:07 [DEBUG   ] Got command TBN from MCS: ref #6330
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '1', '1344443108']
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '2', '1344443108']
2012-08-08 16:25:07 [DEBUG   ] tbn = exited with status True, code 0x00
2012-08-08 16:25:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN     6330   8 56147 59107105 A  ERROR'
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '3', '1344443108']
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '4', '1344443108']
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '5', '1344443108']
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '6', '1344443108']
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '7', '1344443108']
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '8', '1344443108']
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '9', '1344443108']
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '10', '1344443108']
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '11', '1344443108']
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '12', '1344443108']
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '13', '1344443108']
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '14', '1344443108']
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '15', '1344443108']
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '16', '1344443108']
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '17', '1344443108']
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '18', '1344443108']
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '19', '1344443108']
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '20', '1344443108']
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '21', '1344443108']
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '22', '1344443108']
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '23', '1344443108']
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '24', '1344443108']
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '25', '1344443108']
2012-08-08 16:25:07 [DEBUG   ] spawn_process: at 2012-08-08 16:25:07 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '26', '1344443108']
2012-08-08 16:25:07 [INFO    ] Finished spawning TBN in 0.057 s
2012-08-08 16:25:07 [DEBUG   ] Finished updating ant stats in 0.921 seconds
2012-08-08 16:25:27 [DEBUG   ] Finished updating ant stats in 0.669 seconds
2012-08-08 16:25:47 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2012-08-08 16:26:00 [DEBUG   ] Finished updating board flags in 1.321 seconds
2012-08-08 16:26:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-08 16:26:28 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-08 16:26:47 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-08 16:27:00 [DEBUG   ] Finished updating board flags in 1.266 seconds
2012-08-08 16:27:08 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-08 16:27:28 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2012-08-08 16:27:48 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2012-08-08 16:28:00 [DEBUG   ] Finished updating board flags in 1.454 seconds
2012-08-08 16:28:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 16:28:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 16:28:48 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-08 16:29:00 [DEBUG   ] Finished updating board flags in 1.337 seconds
2012-08-08 16:29:06 [DEBUG   ] Got command RPT from MCS: ref #6331
2012-08-08 16:29:06 [DEBUG   ] summary = ERROR
2012-08-08 16:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6331  13 56147 59346176 A  ERRORERROR'
2012-08-08 16:29:06 [DEBUG   ] Got command RPT from MCS: ref #6332
2012-08-08 16:29:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 16:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6332  77 56147 59346177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 16:29:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 16:29:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 16:29:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 16:30:00 [DEBUG   ] Finished updating board flags in 1.235 seconds
2012-08-08 16:30:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-08 16:30:29 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-08 16:30:49 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-08 16:31:00 [DEBUG   ] Finished updating board flags in 1.233 seconds
2012-08-08 16:31:09 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-08 16:31:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 16:31:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-08 16:31:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 16:32:00 [DEBUG   ] Finished updating board flags in 1.235 seconds
2012-08-08 16:32:09 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-08 16:32:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 16:32:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 16:33:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 16:33:00 [DEBUG   ] Finished updating board flags in 1.233 seconds
2012-08-08 16:33:09 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 16:33:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 16:33:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 16:34:00 [DEBUG   ] Finished updating board flags in 1.233 seconds
2012-08-08 16:34:06 [DEBUG   ] Got command RPT from MCS: ref #6348
2012-08-08 16:34:06 [DEBUG   ] summary = ERROR
2012-08-08 16:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6348  13 56147 59646188 A  ERRORERROR'
2012-08-08 16:34:06 [DEBUG   ] Got command RPT from MCS: ref #6349
2012-08-08 16:34:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 16:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6349  77 56147 59646189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 16:34:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 16:34:29 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-08 16:34:50 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-08 16:35:01 [DEBUG   ] Finished updating board flags in 1.425 seconds
2012-08-08 16:35:10 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-08 16:35:30 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-08 16:35:50 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-08 16:35:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 16:36:01 [DEBUG   ] Finished updating board flags in 1.418 seconds
2012-08-08 16:36:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 16:36:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 16:36:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-08 16:37:01 [DEBUG   ] Finished updating board flags in 1.460 seconds
2012-08-08 16:37:10 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-08 16:37:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 16:37:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 16:38:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 16:38:01 [DEBUG   ] Finished updating board flags in 1.346 seconds
2012-08-08 16:38:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 16:38:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 16:38:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 16:39:01 [DEBUG   ] Finished updating board flags in 1.300 seconds
2012-08-08 16:39:06 [DEBUG   ] Got command RPT from MCS: ref #6365
2012-08-08 16:39:06 [DEBUG   ] summary = ERROR
2012-08-08 16:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6365  13 56147 59946173 A  ERRORERROR'
2012-08-08 16:39:06 [DEBUG   ] Got command RPT from MCS: ref #6366
2012-08-08 16:39:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 16:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6366  77 56147 59946173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 16:39:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 16:39:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 16:39:50 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-08 16:40:01 [DEBUG   ] Finished updating board flags in 1.304 seconds
2012-08-08 16:40:10 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2012-08-08 16:40:31 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2012-08-08 16:40:51 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-08 16:41:01 [DEBUG   ] Finished updating board flags in 1.308 seconds
2012-08-08 16:41:11 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-08 16:41:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 16:41:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 16:42:01 [DEBUG   ] Finished updating board flags in 1.304 seconds
2012-08-08 16:42:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 16:42:31 [DEBUG   ] Finished updating ant stats in 0.993 seconds
2012-08-08 16:42:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 16:43:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 16:43:01 [DEBUG   ] Finished updating board flags in 1.487 seconds
2012-08-08 16:43:11 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2012-08-08 16:43:31 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-08 16:43:52 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2012-08-08 16:44:01 [DEBUG   ] Finished updating board flags in 1.299 seconds
2012-08-08 16:44:06 [DEBUG   ] Got command RPT from MCS: ref #6382
2012-08-08 16:44:06 [DEBUG   ] summary = ERROR
2012-08-08 16:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6382  13 56147 60246172 A  ERRORERROR'
2012-08-08 16:44:06 [DEBUG   ] Got command RPT from MCS: ref #6383
2012-08-08 16:44:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 16:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6383  77 56147 60246173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 16:44:12 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-08 16:44:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 16:44:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 16:45:01 [DEBUG   ] Finished updating board flags in 1.232 seconds
2012-08-08 16:45:12 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2012-08-08 16:45:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 16:45:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-08 16:46:01 [DEBUG   ] Finished updating board flags in 1.239 seconds
2012-08-08 16:46:12 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-08 16:46:32 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-08 16:46:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 16:47:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2012-08-08 16:47:01 [CRITICAL] MGT underflow detected on beam(s) 1
2012-08-08 16:47:01 [DEBUG   ] Finished updating board flags in 1.237 seconds
2012-08-08 16:47:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 16:47:32 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-08 16:47:52 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 16:48:01 [DEBUG   ] Finished updating board flags in 1.230 seconds
2012-08-08 16:48:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 16:48:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 16:48:52 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-08 16:49:01 [DEBUG   ] Finished updating board flags in 1.236 seconds
2012-08-08 16:49:06 [DEBUG   ] Got command RPT from MCS: ref #6399
2012-08-08 16:49:06 [DEBUG   ] summary = ERROR
2012-08-08 16:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6399  13 56147 60546176 A  ERRORERROR'
2012-08-08 16:49:06 [DEBUG   ] Got command RPT from MCS: ref #6400
2012-08-08 16:49:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 16:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6400  77 56147 60546177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 16:49:12 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2012-08-08 16:49:33 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-08 16:49:53 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-08 16:50:02 [DEBUG   ] Finished updating board flags in 1.430 seconds
2012-08-08 16:50:13 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-08 16:50:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 16:50:53 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-08 16:51:02 [DEBUG   ] Finished updating board flags in 1.423 seconds
2012-08-08 16:51:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-08 16:51:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 16:51:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 16:52:02 [DEBUG   ] Finished updating board flags in 1.387 seconds
2012-08-08 16:52:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 16:52:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 16:52:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 16:53:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2012-08-08 16:53:02 [CRITICAL] MGT underflow detected on beam(s) 1
2012-08-08 16:53:02 [DEBUG   ] Finished updating board flags in 1.236 seconds
2012-08-08 16:53:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 16:53:33 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-08 16:53:53 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 16:54:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2012-08-08 16:54:02 [CRITICAL] MGT underflow detected on beam(s) 1
2012-08-08 16:54:02 [DEBUG   ] Finished updating board flags in 1.268 seconds
2012-08-08 16:54:06 [DEBUG   ] Got command RPT from MCS: ref #6416
2012-08-08 16:54:06 [DEBUG   ] summary = ERROR
2012-08-08 16:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6416  13 56147 60846177 A  ERRORERROR'
2012-08-08 16:54:06 [DEBUG   ] Got command RPT from MCS: ref #6417
2012-08-08 16:54:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 16:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6417  77 56147 60846177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 16:54:14 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2012-08-08 16:54:34 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2012-08-08 16:54:54 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-08 16:55:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 16:55:02 [DEBUG   ] Finished updating board flags in 1.262 seconds
2012-08-08 16:55:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 16:55:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 16:55:54 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-08 16:56:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2012-08-08 16:56:02 [CRITICAL] MGT underflow detected on beam(s) 1
2012-08-08 16:56:02 [DEBUG   ] Finished updating board flags in 1.259 seconds
2012-08-08 16:56:14 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2012-08-08 16:56:34 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2012-08-08 16:56:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 16:57:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 16:57:02 [DEBUG   ] Finished updating board flags in 1.257 seconds
2012-08-08 16:57:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 16:57:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-08 16:57:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 16:58:02 [DEBUG   ] Finished updating board flags in 1.264 seconds
2012-08-08 16:58:14 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-08 16:58:35 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2012-08-08 16:58:55 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-08 16:59:02 [DEBUG   ] Finished updating board flags in 1.264 seconds
2012-08-08 16:59:06 [DEBUG   ] Got command RPT from MCS: ref #6433
2012-08-08 16:59:06 [DEBUG   ] summary = ERROR
2012-08-08 16:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6433  13 56147 61146176 A  ERRORERROR'
2012-08-08 16:59:06 [DEBUG   ] Got command RPT from MCS: ref #6434
2012-08-08 16:59:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 16:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6434  77 56147 61146177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 16:59:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 16:59:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 16:59:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 17:00:02 [DEBUG   ] Finished updating board flags in 1.459 seconds
2012-08-08 17:00:15 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2012-08-08 17:00:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 17:00:55 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-08 17:01:02 [DEBUG   ] Finished updating board flags in 1.414 seconds
2012-08-08 17:01:15 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2012-08-08 17:01:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 17:01:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 17:02:02 [DEBUG   ] Finished updating board flags in 1.340 seconds
2012-08-08 17:02:15 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-08 17:02:35 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 17:02:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 17:03:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 17:03:02 [DEBUG   ] Finished updating board flags in 1.248 seconds
2012-08-08 17:03:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 17:03:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 17:03:55 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-08 17:04:02 [DEBUG   ] Finished updating board flags in 1.234 seconds
2012-08-08 17:04:06 [DEBUG   ] Got command RPT from MCS: ref #6450
2012-08-08 17:04:06 [DEBUG   ] summary = ERROR
2012-08-08 17:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6450  13 56147 61446189 A  ERRORERROR'
2012-08-08 17:04:06 [DEBUG   ] Got command RPT from MCS: ref #6451
2012-08-08 17:04:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 17:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6451  77 56147 61446189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 17:04:16 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2012-08-08 17:04:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 17:04:56 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2012-08-08 17:05:02 [DEBUG   ] Finished updating board flags in 1.234 seconds
2012-08-08 17:05:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 17:05:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-08 17:05:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 17:06:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 17:06:02 [DEBUG   ] Finished updating board flags in 1.233 seconds
2012-08-08 17:06:16 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-08 17:06:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 17:06:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 17:07:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 17:07:02 [DEBUG   ] Finished updating board flags in 1.231 seconds
2012-08-08 17:07:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 17:07:36 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2012-08-08 17:07:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 17:08:03 [DEBUG   ] Finished updating board flags in 1.426 seconds
2012-08-08 17:08:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 17:08:36 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 17:08:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-08 17:09:03 [DEBUG   ] Finished updating board flags in 1.438 seconds
2012-08-08 17:09:06 [DEBUG   ] Got command RPT from MCS: ref #6467
2012-08-08 17:09:06 [DEBUG   ] summary = ERROR
2012-08-08 17:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6467  13 56147 61746180 A  ERRORERROR'
2012-08-08 17:09:06 [DEBUG   ] Got command RPT from MCS: ref #6468
2012-08-08 17:09:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 17:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6468  77 56147 61746181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 17:09:17 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-08 17:09:37 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-08 17:09:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 17:10:03 [DEBUG   ] Finished updating board flags in 1.377 seconds
2012-08-08 17:10:17 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2012-08-08 17:10:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-08 17:10:57 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 17:11:03 [DEBUG   ] Finished updating board flags in 1.231 seconds
2012-08-08 17:11:17 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2012-08-08 17:11:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 17:11:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 17:12:03 [DEBUG   ] Finished updating board flags in 1.246 seconds
2012-08-08 17:12:17 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 17:12:38 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-08 17:12:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 17:13:03 [DEBUG   ] Finished updating board flags in 1.237 seconds
2012-08-08 17:13:18 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-08 17:13:38 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-08 17:13:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 17:14:03 [DEBUG   ] Finished updating board flags in 1.243 seconds
2012-08-08 17:14:06 [DEBUG   ] Got command RPT from MCS: ref #6484
2012-08-08 17:14:06 [DEBUG   ] summary = ERROR
2012-08-08 17:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6484  13 56147 62046176 A  ERRORERROR'
2012-08-08 17:14:06 [DEBUG   ] Got command RPT from MCS: ref #6485
2012-08-08 17:14:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 17:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6485  77 56147 62046177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 17:14:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 17:14:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2012-08-08 17:14:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 17:15:03 [DEBUG   ] Finished updating board flags in 1.245 seconds
2012-08-08 17:15:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 17:15:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-08 17:15:58 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 17:16:03 [DEBUG   ] Finished updating board flags in 1.258 seconds
2012-08-08 17:16:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 17:16:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 17:16:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 17:17:03 [DEBUG   ] Finished updating board flags in 1.259 seconds
2012-08-08 17:17:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 17:17:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 17:17:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 17:18:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 17:18:03 [DEBUG   ] Finished updating board flags in 1.261 seconds
2012-08-08 17:18:18 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-08 17:18:38 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-08 17:18:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 17:19:03 [DEBUG   ] Finished updating board flags in 1.262 seconds
2012-08-08 17:19:06 [DEBUG   ] Got command RPT from MCS: ref #6505
2012-08-08 17:19:06 [DEBUG   ] summary = ERROR
2012-08-08 17:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6505  13 56147 62346180 A  ERRORERROR'
2012-08-08 17:19:06 [DEBUG   ] Got command RPT from MCS: ref #6506
2012-08-08 17:19:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 17:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6506  77 56147 62346181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 17:19:19 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-08 17:19:39 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-08 17:19:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 17:20:03 [DEBUG   ] Finished updating board flags in 1.440 seconds
2012-08-08 17:20:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 17:20:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 17:20:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 17:21:03 [DEBUG   ] Finished updating board flags in 1.373 seconds
2012-08-08 17:21:19 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-08 17:21:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 17:21:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 17:22:03 [DEBUG   ] Finished updating board flags in 1.277 seconds
2012-08-08 17:22:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 17:22:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 17:22:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 17:23:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 17:23:03 [DEBUG   ] Finished updating board flags in 1.274 seconds
2012-08-08 17:23:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 17:23:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-08 17:23:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 17:24:04 [DEBUG   ] Finished updating board flags in 1.448 seconds
2012-08-08 17:24:06 [DEBUG   ] Got command RPT from MCS: ref #6522
2012-08-08 17:24:06 [DEBUG   ] summary = ERROR
2012-08-08 17:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6522  13 56147 62646185 A  ERRORERROR'
2012-08-08 17:24:06 [DEBUG   ] Got command RPT from MCS: ref #6523
2012-08-08 17:24:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 17:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6523  77 56147 62646185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 17:24:20 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-08 17:24:40 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-08 17:25:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 17:25:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 17:25:04 [DEBUG   ] Finished updating board flags in 1.369 seconds
2012-08-08 17:25:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 17:25:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 17:26:00 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2012-08-08 17:26:04 [DEBUG   ] Finished updating board flags in 1.279 seconds
2012-08-08 17:26:20 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-08 17:26:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 17:27:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 17:27:04 [DEBUG   ] Finished updating board flags in 1.274 seconds
2012-08-08 17:27:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 17:27:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 17:28:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 17:28:04 [DEBUG   ] Finished updating board flags in 1.316 seconds
2012-08-08 17:28:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 17:28:40 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2012-08-08 17:29:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 17:29:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 17:29:04 [DEBUG   ] Finished updating board flags in 1.319 seconds
2012-08-08 17:29:06 [DEBUG   ] Got command RPT from MCS: ref #6539
2012-08-08 17:29:06 [DEBUG   ] summary = ERROR
2012-08-08 17:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6539  13 56147 62946184 A  ERRORERROR'
2012-08-08 17:29:06 [DEBUG   ] Got command RPT from MCS: ref #6540
2012-08-08 17:29:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 17:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6540  77 56147 62946185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 17:29:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 17:29:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 17:30:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 17:30:04 [DEBUG   ] Finished updating board flags in 1.567 seconds
2012-08-08 17:30:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 17:30:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 17:31:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 17:31:04 [DEBUG   ] Finished updating board flags in 1.435 seconds
2012-08-08 17:31:20 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2012-08-08 17:31:41 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-08 17:32:01 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-08 17:32:04 [DEBUG   ] Finished updating board flags in 1.235 seconds
2012-08-08 17:32:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2012-08-08 17:32:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 17:33:01 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 17:33:04 [DEBUG   ] Finished updating board flags in 1.231 seconds
2012-08-08 17:33:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 17:33:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 17:34:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-08 17:34:04 [DEBUG   ] Finished updating board flags in 1.243 seconds
2012-08-08 17:34:06 [DEBUG   ] Got command RPT from MCS: ref #6556
2012-08-08 17:34:06 [DEBUG   ] summary = ERROR
2012-08-08 17:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6556  13 56147 63246192 A  ERRORERROR'
2012-08-08 17:34:06 [DEBUG   ] Got command RPT from MCS: ref #6557
2012-08-08 17:34:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 17:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6557  77 56147 63246193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 17:34:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 17:34:41 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2012-08-08 17:35:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-08 17:35:04 [DEBUG   ] Finished updating board flags in 1.232 seconds
2012-08-08 17:35:22 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-08 17:35:42 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-08 17:36:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 17:36:04 [DEBUG   ] Finished updating board flags in 1.227 seconds
2012-08-08 17:36:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 17:36:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 17:37:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-08 17:37:04 [DEBUG   ] Finished updating board flags in 1.263 seconds
2012-08-08 17:37:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 17:37:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 17:38:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-08 17:38:05 [DEBUG   ] Finished updating board flags in 1.463 seconds
2012-08-08 17:38:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 17:38:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 17:39:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 17:39:05 [DEBUG   ] Finished updating board flags in 1.404 seconds
2012-08-08 17:39:06 [DEBUG   ] Got command RPT from MCS: ref #6573
2012-08-08 17:39:06 [DEBUG   ] summary = ERROR
2012-08-08 17:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6573  13 56147 63546184 A  ERRORERROR'
2012-08-08 17:39:06 [DEBUG   ] Got command RPT from MCS: ref #6574
2012-08-08 17:39:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 17:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6574  77 56147 63546185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 17:39:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 17:39:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 17:40:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 17:40:05 [DEBUG   ] Finished updating board flags in 1.391 seconds
2012-08-08 17:40:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 17:40:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-08 17:41:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 17:41:05 [DEBUG   ] Finished updating board flags in 1.307 seconds
2012-08-08 17:41:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 17:41:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 17:42:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 17:42:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 17:42:05 [DEBUG   ] Finished updating board flags in 1.291 seconds
2012-08-08 17:42:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 17:42:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 17:43:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 17:43:05 [DEBUG   ] Finished updating board flags in 1.318 seconds
2012-08-08 17:43:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 17:43:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 17:44:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 17:44:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 17:44:05 [DEBUG   ] Finished updating board flags in 1.407 seconds
2012-08-08 17:44:06 [DEBUG   ] Got command RPT from MCS: ref #6590
2012-08-08 17:44:06 [DEBUG   ] summary = ERROR
2012-08-08 17:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6590  13 56147 63846188 A  ERRORERROR'
2012-08-08 17:44:06 [DEBUG   ] Got command RPT from MCS: ref #6591
2012-08-08 17:44:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 17:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6591  77 56147 63846189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 17:44:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 17:44:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 17:45:02 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-08 17:45:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 17:45:05 [DEBUG   ] Finished updating board flags in 1.236 seconds
2012-08-08 17:45:23 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-08 17:45:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 17:46:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 17:46:05 [DEBUG   ] Finished updating board flags in 1.446 seconds
2012-08-08 17:46:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 17:46:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 17:47:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 17:47:05 [DEBUG   ] Finished updating board flags in 1.436 seconds
2012-08-08 17:47:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 17:47:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 17:48:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 17:48:05 [DEBUG   ] Finished updating board flags in 1.393 seconds
2012-08-08 17:48:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 17:48:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-08 17:49:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 17:49:05 [DEBUG   ] Finished updating board flags in 1.275 seconds
2012-08-08 17:49:06 [DEBUG   ] Got command RPT from MCS: ref #6607
2012-08-08 17:49:06 [DEBUG   ] summary = ERROR
2012-08-08 17:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6607  13 56147 64146184 A  ERRORERROR'
2012-08-08 17:49:06 [DEBUG   ] Got command RPT from MCS: ref #6608
2012-08-08 17:49:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 17:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6608  77 56147 64146185 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 17:49:23 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-08 17:49:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 17:50:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 17:50:06 [DEBUG   ] Finished updating board flags in 1.482 seconds
2012-08-08 17:50:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 17:50:43 [DEBUG   ] Got command INI from MCS: ref #6624
2012-08-08 17:50:43 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2012-08-08 17:50:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI     6624   8 56147 64243308 ABOOTING'
2012-08-08 17:50:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 17:51:03 [INFO    ] -------------------
2012-08-08 17:51:03 [INFO    ]  LWA board status
2012-08-08 17:51:03 [INFO    ] -------------------
2012-08-08 17:51:03 [INFO    ] DP 1: 2 lwa27
2012-08-08 17:51:03 [INFO    ] DP 1: 3 lwa24
2012-08-08 17:51:03 [INFO    ] DP 1: 4 lwa23
2012-08-08 17:51:03 [INFO    ] DP 1: 5 lwa18
2012-08-08 17:51:03 [INFO    ] DP 1: 6 lwa10
2012-08-08 17:51:03 [INFO    ] DP 1: 7 lwa32
2012-08-08 17:51:03 [INFO    ] DP 1: 8 lwa11
2012-08-08 17:51:03 [INFO    ] DP 1: 9 lwa30
2012-08-08 17:51:03 [INFO    ] DP 1: 10 lwa12
2012-08-08 17:51:03 [INFO    ] DP 1: 11 lwa8
2012-08-08 17:51:03 [INFO    ] DP 1: 12 lwa13
2012-08-08 17:51:03 [INFO    ] DP 1: 13 lwa26
2012-08-08 17:51:03 [INFO    ] DP 1: 14 lwa14
2012-08-08 17:51:03 [INFO    ] DP 1: 16 lwa22
2012-08-08 17:51:03 [INFO    ] DP 1: 17 lwa20
2012-08-08 17:51:03 [INFO    ] DP 1: 18 lwa1
2012-08-08 17:51:03 [INFO    ] DP 1: 19 lwa5
2012-08-08 17:51:03 [INFO    ] DP 1: 20 lwa25
2012-08-08 17:51:03 [INFO    ] DP 1: 21 lwa35
2012-08-08 17:51:03 [INFO    ] DP 1: 22 lwa19
2012-08-08 17:51:03 [INFO    ] DP 1: 23 lwa21
2012-08-08 17:51:03 [INFO    ] DP 1: 24 lwa6
2012-08-08 17:51:03 [INFO    ] DP 1: 25 lwa7
2012-08-08 17:51:03 [INFO    ] DP 1: 26 lwa33
2012-08-08 17:51:03 [INFO    ] DP 1: 27 lwa15
2012-08-08 17:51:03 [INFO    ] DP 1: 28 lwa28
2012-08-08 17:51:03 [INFO    ] DP 2: 1 lwa16
2012-08-08 17:51:03 [INFO    ] DP 2: 15 lwa34
2012-08-08 17:51:03 [INFO    ] Total of 28 boards
2012-08-08 17:51:03 [INFO    ] Total of 260 stands
2012-08-08 17:51:03 [INFO    ] -------------------
2012-08-08 17:51:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:07 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3422
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3423
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3424
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3425
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3426
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3427
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3428
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3429
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3430
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3431
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3432
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3433
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3434
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3435
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3436
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3437
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3438
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3439
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3440
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3441
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3442
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3443
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3444
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3445
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3446
2012-08-08 17:51:10 [DEBUG   ] 2012-08-08 17:51:10 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3447
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3422 exited with status 0
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3423 exited with status 0
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3424 exited with status 0
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3425 exited with status 0
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3426 exited with status 0
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3427 exited with status 0
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3428 exited with status 0
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3429 exited with status 0
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3430 exited with status 0
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3431 exited with status 0
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3432 exited with status 0
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3433 exited with status 0
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3434 exited with status 0
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3435 exited with status 0
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3436 exited with status 0
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3437 exited with status 0
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3438 exited with status 0
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3439 exited with status 0
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3440 exited with status 0
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3441 exited with status 0
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3442 exited with status 0
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3443 exited with status 0
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3444 exited with status 0
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3445 exited with status 0
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3446 exited with status 0
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3447 exited with status 0
2012-08-08 17:51:23 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] spawn_process: at 2012-08-08 17:51:23 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 3474
2012-08-08 17:51:23 [DEBUG   ] 2012-08-08 17:51:23 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 3475
2012-08-08 17:51:28 [DEBUG   ] 2012-08-08 17:51:28 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 3474 exited with status 0
2012-08-08 17:51:28 [DEBUG   ] 2012-08-08 17:51:28 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 3475 exited with status 0
2012-08-08 17:51:28 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2012-08-08 17:51:28 [DEBUG   ] spawn_process: at 2012-08-08 17:51:28 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2012-08-08 17:51:28 [DEBUG   ] spawn_process: at 2012-08-08 17:51:28 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2012-08-08 17:51:28 [INFO    ] Setting Beam 1 xbars
2012-08-08 17:51:28 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2012-08-08 17:51:28 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2012-08-08 17:51:28 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2012-08-08 17:51:29 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2012-08-08 17:51:29 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2012-08-08 17:51:29 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2012-08-08 17:51:29 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2012-08-08 17:51:29 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2012-08-08 17:51:29 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2012-08-08 17:51:29 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2012-08-08 17:51:29 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2012-08-08 17:51:29 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2012-08-08 17:51:30 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2012-08-08 17:51:30 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2012-08-08 17:51:30 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2012-08-08 17:51:30 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2012-08-08 17:51:30 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2012-08-08 17:51:30 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2012-08-08 17:51:30 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2012-08-08 17:51:30 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2012-08-08 17:51:30 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2012-08-08 17:51:31 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2012-08-08 17:51:31 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2012-08-08 17:51:31 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2012-08-08 17:51:31 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2012-08-08 17:51:31 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2012-08-08 17:51:31 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2012-08-08 17:51:31 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2012-08-08 17:51:31 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2012-08-08 17:51:31 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2012-08-08 17:51:31 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2012-08-08 17:51:32 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2012-08-08 17:51:32 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2012-08-08 17:51:32 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2012-08-08 17:51:32 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2012-08-08 17:51:32 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2012-08-08 17:51:32 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2012-08-08 17:51:32 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2012-08-08 17:51:32 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2012-08-08 17:51:32 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2012-08-08 17:51:33 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2012-08-08 17:51:33 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2012-08-08 17:51:33 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2012-08-08 17:51:33 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2012-08-08 17:51:33 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2012-08-08 17:51:33 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2012-08-08 17:51:33 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2012-08-08 17:51:33 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2012-08-08 17:51:33 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2012-08-08 17:51:34 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2012-08-08 17:51:34 [INFO    ] Setting Beam 2 xbars
2012-08-08 17:51:34 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2012-08-08 17:51:34 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2012-08-08 17:51:34 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2012-08-08 17:51:34 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2012-08-08 17:51:34 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2012-08-08 17:51:34 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2012-08-08 17:51:34 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2012-08-08 17:51:34 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2012-08-08 17:51:35 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2012-08-08 17:51:35 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2012-08-08 17:51:35 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2012-08-08 17:51:35 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2012-08-08 17:51:35 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2012-08-08 17:51:35 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2012-08-08 17:51:35 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2012-08-08 17:51:35 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2012-08-08 17:51:35 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2012-08-08 17:51:36 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2012-08-08 17:51:36 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2012-08-08 17:51:36 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2012-08-08 17:51:36 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2012-08-08 17:51:36 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2012-08-08 17:51:36 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2012-08-08 17:51:36 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2012-08-08 17:51:36 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2012-08-08 17:51:36 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2012-08-08 17:51:36 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2012-08-08 17:51:37 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2012-08-08 17:51:37 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2012-08-08 17:51:37 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2012-08-08 17:51:37 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2012-08-08 17:51:37 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2012-08-08 17:51:37 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2012-08-08 17:51:37 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2012-08-08 17:51:37 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2012-08-08 17:51:37 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2012-08-08 17:51:38 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2012-08-08 17:51:38 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2012-08-08 17:51:38 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2012-08-08 17:51:38 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2012-08-08 17:51:38 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2012-08-08 17:51:38 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2012-08-08 17:51:38 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2012-08-08 17:51:38 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2012-08-08 17:51:38 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2012-08-08 17:51:39 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2012-08-08 17:51:39 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2012-08-08 17:51:39 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2012-08-08 17:51:39 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2012-08-08 17:51:39 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2012-08-08 17:51:39 [INFO    ] Setting Beam 3 xbars
2012-08-08 17:51:39 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2012-08-08 17:51:39 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2012-08-08 17:51:39 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2012-08-08 17:51:39 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2012-08-08 17:51:40 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2012-08-08 17:51:40 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2012-08-08 17:51:40 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2012-08-08 17:51:40 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2012-08-08 17:51:40 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2012-08-08 17:51:40 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2012-08-08 17:51:40 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2012-08-08 17:51:40 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2012-08-08 17:51:40 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2012-08-08 17:51:40 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2012-08-08 17:51:41 [DEBUG   ] Got command RPT from MCS: ref #6625
2012-08-08 17:51:41 [DEBUG   ] summary = BOOTING
2012-08-08 17:51:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6625  15 56147 64301045 ABOOTINGBOOTING'
2012-08-08 17:51:41 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2012-08-08 17:51:41 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2012-08-08 17:51:41 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2012-08-08 17:51:41 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2012-08-08 17:51:41 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2012-08-08 17:51:41 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2012-08-08 17:51:41 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2012-08-08 17:51:41 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2012-08-08 17:51:41 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2012-08-08 17:51:42 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2012-08-08 17:51:42 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2012-08-08 17:51:42 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2012-08-08 17:51:42 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2012-08-08 17:51:42 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2012-08-08 17:51:42 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2012-08-08 17:51:42 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2012-08-08 17:51:42 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2012-08-08 17:51:42 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2012-08-08 17:51:43 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2012-08-08 17:51:43 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2012-08-08 17:51:43 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2012-08-08 17:51:43 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2012-08-08 17:51:43 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2012-08-08 17:51:43 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2012-08-08 17:51:43 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2012-08-08 17:51:43 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2012-08-08 17:51:43 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2012-08-08 17:51:44 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2012-08-08 17:51:44 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2012-08-08 17:51:44 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2012-08-08 17:51:44 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2012-08-08 17:51:44 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2012-08-08 17:51:44 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2012-08-08 17:51:44 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2012-08-08 17:51:44 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2012-08-08 17:51:44 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2012-08-08 17:51:45 [INFO    ] Setting Beam 4 xbars
2012-08-08 17:51:45 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2012-08-08 17:51:45 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 17:51:45 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 17:51:45 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 17:51:45 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 17:51:45 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2012-08-08 17:51:45 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2012-08-08 17:51:45 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2012-08-08 17:51:45 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2012-08-08 17:51:45 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2012-08-08 17:51:46 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2012-08-08 17:51:46 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2012-08-08 17:51:46 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2012-08-08 17:51:46 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2012-08-08 17:51:46 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2012-08-08 17:51:46 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2012-08-08 17:51:46 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2012-08-08 17:51:46 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2012-08-08 17:51:46 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2012-08-08 17:51:47 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2012-08-08 17:51:47 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2012-08-08 17:51:47 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2012-08-08 17:51:47 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2012-08-08 17:51:47 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2012-08-08 17:51:47 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2012-08-08 17:51:47 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2012-08-08 17:51:47 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2012-08-08 17:51:47 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2012-08-08 17:51:48 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2012-08-08 17:51:48 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2012-08-08 17:51:48 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2012-08-08 17:51:48 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2012-08-08 17:51:48 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2012-08-08 17:51:48 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2012-08-08 17:51:48 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2012-08-08 17:51:48 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2012-08-08 17:51:48 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2012-08-08 17:51:49 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2012-08-08 17:51:49 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2012-08-08 17:51:49 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2012-08-08 17:51:49 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2012-08-08 17:51:49 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2012-08-08 17:51:49 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2012-08-08 17:51:49 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2012-08-08 17:51:49 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2012-08-08 17:51:49 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2012-08-08 17:51:50 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2012-08-08 17:51:50 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2012-08-08 17:51:50 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2012-08-08 17:51:50 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2012-08-08 17:51:50 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2012-08-08 17:51:50 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2012-08-08 17:51:50 [INFO    ] All xbars set
2012-08-08 17:51:50 [INFO    ] Setting adder chain routing for all beams
2012-08-08 17:51:55 [INFO    ] Setting beam ids
2012-08-08 17:52:05 [INFO    ] Starting beam delay calibration
2012-08-08 17:52:17 [INFO    ] Beam 1 latency is 5742
2012-08-08 17:52:17 [INFO    ] Beam 2 latency is 5762
2012-08-08 17:52:17 [INFO    ] Beam 3 latency is 5762
2012-08-08 17:52:17 [INFO    ] Beam 4 latency is 5748
2012-08-08 17:52:17 [INFO    ] Stop calibration
2012-08-08 17:52:25 [INFO    ] Beam delay calibration successful
2012-08-08 17:52:25 [INFO    ] Calibration passed
2012-08-08 17:52:25 [DEBUG   ] spawn_process: at 2012-08-08 17:52:25 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2012-08-08 17:52:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2012-08-08 17:52:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2012-08-08 17:52:25 [DEBUG   ] spawn_process: at 2012-08-08 17:52:25 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2012-08-08 17:52:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2012-08-08 17:52:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2012-08-08 17:52:25 [DEBUG   ] spawn_process: at 2012-08-08 17:52:25 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2012-08-08 17:52:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2012-08-08 17:52:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2012-08-08 17:52:25 [DEBUG   ] spawn_process: at 2012-08-08 17:52:25 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2012-08-08 17:52:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2012-08-08 17:52:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2012-08-08 17:52:26 [DEBUG   ] Finished updating ant stats in 0.520 seconds
2012-08-08 17:52:26 [INFO    ] Started antennas statistics background thread
2012-08-08 17:52:26 [INFO    ] Started board flags background thread
2012-08-08 17:52:26 [INFO    ] Started BAM background thread
2012-08-08 17:52:26 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 with PID 5066
2012-08-08 17:52:26 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 with PID 5069
2012-08-08 17:52:26 [INFO    ] Finished the INI process in 103.652 s
2012-08-08 17:52:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 17:52:27 [DEBUG   ] Finished updating board flags in 0.821 seconds
2012-08-08 17:52:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 17:53:06 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 17:53:26 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 17:53:27 [DEBUG   ] Finished updating board flags in 0.825 seconds
2012-08-08 17:53:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 17:54:06 [DEBUG   ] Got command RPT from MCS: ref #6626
2012-08-08 17:54:06 [DEBUG   ] summary = NORMAL
2012-08-08 17:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6626  14 56147 64446189 A NORMALNORMAL'
2012-08-08 17:54:06 [DEBUG   ] Got command RPT from MCS: ref #6627
2012-08-08 17:54:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 17:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6627  48 56147 64446189 A NORMALSystem calibrated and operating normally'
2012-08-08 17:54:06 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 17:54:16 [DEBUG   ] Got command RPT from MCS: ref #6643
2012-08-08 17:54:16 [DEBUG   ] summary = NORMAL
2012-08-08 17:54:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6643  14 56147 64456268 A NORMALNORMAL'
2012-08-08 17:54:26 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 17:54:27 [DEBUG   ] Finished updating board flags in 0.887 seconds
2012-08-08 17:54:42 [DEBUG   ] Got command RPT from MCS: ref #6644
2012-08-08 17:54:42 [DEBUG   ] summary = NORMAL
2012-08-08 17:54:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6644  14 56147 64482476 A NORMALNORMAL'
2012-08-08 17:54:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 17:55:06 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 17:55:26 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 17:55:27 [DEBUG   ] Finished updating board flags in 1.128 seconds
2012-08-08 17:55:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 17:56:06 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 17:56:26 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 17:56:27 [DEBUG   ] Finished updating board flags in 0.915 seconds
2012-08-08 17:56:46 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2012-08-08 17:57:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 17:57:27 [DEBUG   ] Finished updating ant stats in 1.235 seconds
2012-08-08 17:57:28 [DEBUG   ] Finished updating board flags in 0.952 seconds
2012-08-08 17:57:47 [DEBUG   ] Finished updating ant stats in 1.170 seconds
2012-08-08 17:58:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 17:58:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 17:58:28 [DEBUG   ] Finished updating board flags in 0.907 seconds
2012-08-08 17:58:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 17:59:06 [DEBUG   ] Got command RPT from MCS: ref #6648
2012-08-08 17:59:06 [DEBUG   ] summary = NORMAL
2012-08-08 17:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6648  14 56147 64746221 A NORMALNORMAL'
2012-08-08 17:59:06 [DEBUG   ] Got command RPT from MCS: ref #6649
2012-08-08 17:59:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 17:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6649  48 56147 64746221 A NORMALSystem calibrated and operating normally'
2012-08-08 17:59:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 17:59:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 17:59:28 [DEBUG   ] Finished updating board flags in 1.052 seconds
2012-08-08 17:59:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 18:00:07 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-08 18:00:27 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2012-08-08 18:00:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 18:00:28 [DEBUG   ] Finished updating board flags in 0.902 seconds
2012-08-08 18:00:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 18:01:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 18:01:07 [DEBUG   ] Got command INI from MCS: ref #6665
2012-08-08 18:01:07 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2012-08-08 18:01:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI     6665   8 56147 64867877 ABOOTING'
2012-08-08 18:01:24 [INFO    ] -------------------
2012-08-08 18:01:24 [INFO    ]  LWA board status
2012-08-08 18:01:24 [INFO    ] -------------------
2012-08-08 18:01:24 [INFO    ] DP 1: 2 lwa27
2012-08-08 18:01:24 [INFO    ] DP 1: 3 lwa24
2012-08-08 18:01:24 [INFO    ] DP 1: 4 lwa23
2012-08-08 18:01:24 [INFO    ] DP 1: 5 lwa18
2012-08-08 18:01:24 [INFO    ] DP 1: 6 lwa10
2012-08-08 18:01:24 [INFO    ] DP 1: 7 lwa32
2012-08-08 18:01:24 [INFO    ] DP 1: 8 lwa11
2012-08-08 18:01:24 [INFO    ] DP 1: 9 lwa30
2012-08-08 18:01:24 [INFO    ] DP 1: 10 lwa12
2012-08-08 18:01:24 [INFO    ] DP 1: 11 lwa8
2012-08-08 18:01:24 [INFO    ] DP 1: 12 lwa13
2012-08-08 18:01:24 [INFO    ] DP 1: 13 lwa26
2012-08-08 18:01:24 [INFO    ] DP 1: 14 lwa14
2012-08-08 18:01:24 [INFO    ] DP 1: 16 lwa22
2012-08-08 18:01:24 [INFO    ] DP 1: 17 lwa20
2012-08-08 18:01:24 [INFO    ] DP 1: 18 lwa1
2012-08-08 18:01:24 [INFO    ] DP 1: 19 lwa5
2012-08-08 18:01:24 [INFO    ] DP 1: 20 lwa25
2012-08-08 18:01:24 [INFO    ] DP 1: 21 lwa35
2012-08-08 18:01:24 [INFO    ] DP 1: 22 lwa19
2012-08-08 18:01:24 [INFO    ] DP 1: 23 lwa21
2012-08-08 18:01:24 [INFO    ] DP 1: 24 lwa6
2012-08-08 18:01:24 [INFO    ] DP 1: 25 lwa7
2012-08-08 18:01:24 [INFO    ] DP 1: 26 lwa33
2012-08-08 18:01:24 [INFO    ] DP 1: 27 lwa15
2012-08-08 18:01:24 [INFO    ] DP 1: 28 lwa28
2012-08-08 18:01:24 [INFO    ] DP 2: 1 lwa16
2012-08-08 18:01:24 [INFO    ] DP 2: 15 lwa34
2012-08-08 18:01:24 [INFO    ] Total of 28 boards
2012-08-08 18:01:24 [INFO    ] Total of 260 stands
2012-08-08 18:01:24 [INFO    ] -------------------
2012-08-08 18:01:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6327
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6328
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6329
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6330
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6331
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6332
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6333
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6334
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6335
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6336
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6337
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6338
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6339
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6340
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6341
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6342
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6343
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6344
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6345
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6346
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6347
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6348
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6349
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6350
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6351
2012-08-08 18:01:31 [DEBUG   ] 2012-08-08 18:01:31 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 6352
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6327 exited with status 0
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6328 exited with status 0
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6329 exited with status 0
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6330 exited with status 0
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6331 exited with status 0
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6332 exited with status 0
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6333 exited with status 0
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6334 exited with status 0
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6335 exited with status 0
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6336 exited with status 0
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6337 exited with status 0
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6338 exited with status 0
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6339 exited with status 0
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6340 exited with status 0
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6341 exited with status 0
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6342 exited with status 0
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6343 exited with status 0
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6344 exited with status 0
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6345 exited with status 0
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6346 exited with status 0
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6347 exited with status 0
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6348 exited with status 0
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6349 exited with status 0
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6350 exited with status 0
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6351 exited with status 0
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 6352 exited with status 0
2012-08-08 18:01:43 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] spawn_process: at 2012-08-08 18:01:43 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 6379
2012-08-08 18:01:43 [DEBUG   ] 2012-08-08 18:01:43 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 6380
2012-08-08 18:01:49 [DEBUG   ] 2012-08-08 18:01:49 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 6379 exited with status 0
2012-08-08 18:01:49 [DEBUG   ] 2012-08-08 18:01:49 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 6380 exited with status 0
2012-08-08 18:01:49 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2012-08-08 18:01:49 [DEBUG   ] spawn_process: at 2012-08-08 18:01:49 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2012-08-08 18:01:49 [DEBUG   ] spawn_process: at 2012-08-08 18:01:49 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2012-08-08 18:01:49 [INFO    ] Setting Beam 1 xbars
2012-08-08 18:01:49 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2012-08-08 18:01:49 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2012-08-08 18:01:49 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2012-08-08 18:01:50 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2012-08-08 18:01:50 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2012-08-08 18:01:50 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2012-08-08 18:01:50 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2012-08-08 18:01:50 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2012-08-08 18:01:50 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2012-08-08 18:01:50 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2012-08-08 18:01:50 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2012-08-08 18:01:50 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2012-08-08 18:01:51 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2012-08-08 18:01:51 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2012-08-08 18:01:51 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2012-08-08 18:01:51 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2012-08-08 18:01:51 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2012-08-08 18:01:51 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2012-08-08 18:01:51 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2012-08-08 18:01:51 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2012-08-08 18:01:51 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2012-08-08 18:01:52 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2012-08-08 18:01:52 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2012-08-08 18:01:52 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2012-08-08 18:01:52 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2012-08-08 18:01:52 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2012-08-08 18:01:52 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2012-08-08 18:01:52 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2012-08-08 18:01:52 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2012-08-08 18:01:52 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2012-08-08 18:01:53 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2012-08-08 18:01:53 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2012-08-08 18:01:53 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2012-08-08 18:01:53 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2012-08-08 18:01:53 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2012-08-08 18:01:53 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2012-08-08 18:01:53 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2012-08-08 18:01:53 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2012-08-08 18:01:53 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2012-08-08 18:01:53 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2012-08-08 18:01:54 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2012-08-08 18:01:54 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2012-08-08 18:01:54 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2012-08-08 18:01:54 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2012-08-08 18:01:54 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2012-08-08 18:01:54 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2012-08-08 18:01:54 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2012-08-08 18:01:54 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2012-08-08 18:01:54 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2012-08-08 18:01:55 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2012-08-08 18:01:55 [INFO    ] Setting Beam 2 xbars
2012-08-08 18:01:55 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2012-08-08 18:01:55 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2012-08-08 18:01:55 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2012-08-08 18:01:55 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2012-08-08 18:01:55 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2012-08-08 18:01:55 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2012-08-08 18:01:55 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2012-08-08 18:01:55 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2012-08-08 18:01:56 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2012-08-08 18:01:56 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2012-08-08 18:01:56 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2012-08-08 18:01:56 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2012-08-08 18:01:56 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2012-08-08 18:01:56 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2012-08-08 18:01:56 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2012-08-08 18:01:56 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2012-08-08 18:01:56 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2012-08-08 18:01:57 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2012-08-08 18:01:57 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2012-08-08 18:01:57 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2012-08-08 18:01:57 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2012-08-08 18:01:57 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2012-08-08 18:01:57 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2012-08-08 18:01:57 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2012-08-08 18:01:57 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2012-08-08 18:01:57 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2012-08-08 18:01:58 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2012-08-08 18:01:58 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2012-08-08 18:01:58 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2012-08-08 18:01:58 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2012-08-08 18:01:58 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2012-08-08 18:01:58 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2012-08-08 18:01:58 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2012-08-08 18:01:58 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2012-08-08 18:01:58 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2012-08-08 18:01:58 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2012-08-08 18:01:59 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2012-08-08 18:01:59 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2012-08-08 18:01:59 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2012-08-08 18:01:59 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2012-08-08 18:01:59 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2012-08-08 18:01:59 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2012-08-08 18:01:59 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2012-08-08 18:01:59 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2012-08-08 18:01:59 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2012-08-08 18:02:00 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2012-08-08 18:02:00 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2012-08-08 18:02:00 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2012-08-08 18:02:00 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2012-08-08 18:02:00 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2012-08-08 18:02:00 [INFO    ] Setting Beam 3 xbars
2012-08-08 18:02:00 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2012-08-08 18:02:00 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2012-08-08 18:02:00 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2012-08-08 18:02:00 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2012-08-08 18:02:01 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2012-08-08 18:02:01 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2012-08-08 18:02:01 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2012-08-08 18:02:01 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2012-08-08 18:02:01 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2012-08-08 18:02:01 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2012-08-08 18:02:01 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2012-08-08 18:02:01 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2012-08-08 18:02:01 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2012-08-08 18:02:02 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2012-08-08 18:02:02 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2012-08-08 18:02:02 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2012-08-08 18:02:02 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2012-08-08 18:02:02 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2012-08-08 18:02:02 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2012-08-08 18:02:02 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2012-08-08 18:02:02 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2012-08-08 18:02:02 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2012-08-08 18:02:03 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2012-08-08 18:02:03 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2012-08-08 18:02:03 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2012-08-08 18:02:03 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2012-08-08 18:02:03 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2012-08-08 18:02:03 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2012-08-08 18:02:03 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2012-08-08 18:02:03 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2012-08-08 18:02:03 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2012-08-08 18:02:03 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2012-08-08 18:02:04 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2012-08-08 18:02:04 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2012-08-08 18:02:04 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2012-08-08 18:02:04 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2012-08-08 18:02:04 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2012-08-08 18:02:04 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2012-08-08 18:02:04 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2012-08-08 18:02:04 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2012-08-08 18:02:04 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2012-08-08 18:02:05 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2012-08-08 18:02:05 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2012-08-08 18:02:05 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2012-08-08 18:02:05 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2012-08-08 18:02:05 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2012-08-08 18:02:05 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2012-08-08 18:02:05 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2012-08-08 18:02:05 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2012-08-08 18:02:05 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2012-08-08 18:02:06 [INFO    ] Setting Beam 4 xbars
2012-08-08 18:02:06 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2012-08-08 18:02:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 18:02:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 18:02:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 18:02:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 18:02:06 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2012-08-08 18:02:06 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2012-08-08 18:02:06 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2012-08-08 18:02:06 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2012-08-08 18:02:07 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2012-08-08 18:02:07 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2012-08-08 18:02:07 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2012-08-08 18:02:07 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2012-08-08 18:02:07 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2012-08-08 18:02:07 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2012-08-08 18:02:07 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2012-08-08 18:02:07 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2012-08-08 18:02:07 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2012-08-08 18:02:08 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2012-08-08 18:02:08 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2012-08-08 18:02:08 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2012-08-08 18:02:08 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2012-08-08 18:02:08 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2012-08-08 18:02:08 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2012-08-08 18:02:08 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2012-08-08 18:02:08 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2012-08-08 18:02:08 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2012-08-08 18:02:09 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2012-08-08 18:02:09 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2012-08-08 18:02:09 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2012-08-08 18:02:09 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2012-08-08 18:02:09 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2012-08-08 18:02:09 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2012-08-08 18:02:09 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2012-08-08 18:02:09 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2012-08-08 18:02:09 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2012-08-08 18:02:09 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2012-08-08 18:02:10 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2012-08-08 18:02:10 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2012-08-08 18:02:10 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2012-08-08 18:02:10 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2012-08-08 18:02:10 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2012-08-08 18:02:10 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2012-08-08 18:02:10 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2012-08-08 18:02:10 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2012-08-08 18:02:10 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2012-08-08 18:02:11 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2012-08-08 18:02:11 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2012-08-08 18:02:11 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2012-08-08 18:02:11 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2012-08-08 18:02:11 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2012-08-08 18:02:11 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2012-08-08 18:02:11 [INFO    ] All xbars set
2012-08-08 18:02:11 [INFO    ] Setting adder chain routing for all beams
2012-08-08 18:02:16 [INFO    ] Setting beam ids
2012-08-08 18:02:26 [INFO    ] Starting beam delay calibration
2012-08-08 18:02:38 [INFO    ] Beam 1 latency is 5724
2012-08-08 18:02:38 [INFO    ] Beam 2 latency is 5763
2012-08-08 18:02:38 [INFO    ] Beam 3 latency is 5749
2012-08-08 18:02:38 [INFO    ] Beam 4 latency is 5721
2012-08-08 18:02:38 [INFO    ] Stop calibration
2012-08-08 18:02:46 [INFO    ] Beam delay calibration successful
2012-08-08 18:02:46 [INFO    ] Calibration passed
2012-08-08 18:02:46 [DEBUG   ] spawn_process: at 2012-08-08 18:02:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2012-08-08 18:02:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2012-08-08 18:02:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2012-08-08 18:02:46 [DEBUG   ] spawn_process: at 2012-08-08 18:02:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2012-08-08 18:02:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2012-08-08 18:02:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2012-08-08 18:02:46 [DEBUG   ] spawn_process: at 2012-08-08 18:02:46 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2012-08-08 18:02:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2012-08-08 18:02:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2012-08-08 18:02:47 [DEBUG   ] spawn_process: at 2012-08-08 18:02:47 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2012-08-08 18:02:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2012-08-08 18:02:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2012-08-08 18:02:48 [INFO    ] Started antennas statistics background thread
2012-08-08 18:02:48 [INFO    ] Started board flags background thread
2012-08-08 18:02:48 [INFO    ] Started BAM background thread
2012-08-08 18:02:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 with PID 7971
2012-08-08 18:02:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 with PID 7974
2012-08-08 18:02:48 [DEBUG   ] Finished updating ant stats in 1.132 seconds
2012-08-08 18:02:48 [INFO    ] Finished the INI process in 100.501 s
2012-08-08 18:02:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 18:02:48 [DEBUG   ] Finished updating board flags in 0.844 seconds
2012-08-08 18:03:08 [DEBUG   ] Finished updating ant stats in 0.973 seconds
2012-08-08 18:03:24 [DEBUG   ] Got command RPT from MCS: ref #6666
2012-08-08 18:03:24 [DEBUG   ] summary = NORMAL
2012-08-08 18:03:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6666  14 56147 65004937 A NORMALNORMAL'
2012-08-08 18:03:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 18:03:48 [DEBUG   ] Finished updating ant stats in 0.828 seconds
2012-08-08 18:03:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 18:03:49 [DEBUG   ] Finished updating board flags in 0.834 seconds
2012-08-08 18:04:06 [DEBUG   ] Got command RPT from MCS: ref #6670
2012-08-08 18:04:06 [DEBUG   ] summary = NORMAL
2012-08-08 18:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6670  14 56147 65046224 A NORMALNORMAL'
2012-08-08 18:04:06 [DEBUG   ] Got command RPT from MCS: ref #6671
2012-08-08 18:04:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 18:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6671  48 56147 65046225 A NORMALSystem calibrated and operating normally'
2012-08-08 18:04:08 [DEBUG   ] Finished updating ant stats in 0.774 seconds
2012-08-08 18:04:24 [DEBUG   ] Got command TBN from MCS: ref #6687
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '1', '1344449066']
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '2', '1344449066']
2012-08-08 18:04:24 [DEBUG   ] tbn = exited with status True, code 0x00
2012-08-08 18:04:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN     6687   8 56147 65064877 A NORMAL'
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '3', '1344449066']
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '4', '1344449066']
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '5', '1344449066']
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '6', '1344449066']
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '7', '1344449066']
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '8', '1344449066']
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '9', '1344449066']
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '10', '1344449066']
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '11', '1344449066']
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '12', '1344449066']
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '13', '1344449066']
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '14', '1344449066']
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '15', '1344449066']
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '16', '1344449066']
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '17', '1344449066']
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '18', '1344449066']
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '19', '1344449066']
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '20', '1344449066']
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '21', '1344449066']
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '22', '1344449066']
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '23', '1344449066']
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '24', '1344449066']
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '25', '1344449066']
2012-08-08 18:04:24 [DEBUG   ] spawn_process: at 2012-08-08 18:04:24 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '26', '1344449066']
2012-08-08 18:04:24 [INFO    ] Finished spawning TBN in 0.049 s
2012-08-08 18:04:28 [DEBUG   ] Finished updating ant stats in 0.670 seconds
2012-08-08 18:04:48 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2012-08-08 18:04:49 [DEBUG   ] Finished updating board flags in 1.240 seconds
2012-08-08 18:04:58 [DEBUG   ] Got command INI from MCS: ref #6688
2012-08-08 18:04:58 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2012-08-08 18:04:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI     6688   8 56147 65098928 ABOOTING'
2012-08-08 18:05:18 [INFO    ] -------------------
2012-08-08 18:05:18 [INFO    ]  LWA board status
2012-08-08 18:05:18 [INFO    ] -------------------
2012-08-08 18:05:18 [INFO    ] DP 1: 2 lwa27
2012-08-08 18:05:18 [INFO    ] DP 1: 3 lwa24
2012-08-08 18:05:18 [INFO    ] DP 1: 4 lwa23
2012-08-08 18:05:18 [INFO    ] DP 1: 5 lwa18
2012-08-08 18:05:18 [INFO    ] DP 1: 6 lwa10
2012-08-08 18:05:18 [INFO    ] DP 1: 7 lwa32
2012-08-08 18:05:18 [INFO    ] DP 1: 8 lwa11
2012-08-08 18:05:18 [INFO    ] DP 1: 9 lwa30
2012-08-08 18:05:18 [INFO    ] DP 1: 10 lwa12
2012-08-08 18:05:18 [INFO    ] DP 1: 11 lwa8
2012-08-08 18:05:18 [INFO    ] DP 1: 12 lwa13
2012-08-08 18:05:18 [INFO    ] DP 1: 13 lwa26
2012-08-08 18:05:18 [INFO    ] DP 1: 14 lwa14
2012-08-08 18:05:18 [INFO    ] DP 1: 16 lwa22
2012-08-08 18:05:18 [INFO    ] DP 1: 17 lwa20
2012-08-08 18:05:18 [INFO    ] DP 1: 18 lwa1
2012-08-08 18:05:18 [INFO    ] DP 1: 19 lwa5
2012-08-08 18:05:18 [INFO    ] DP 1: 20 lwa25
2012-08-08 18:05:18 [INFO    ] DP 1: 21 lwa35
2012-08-08 18:05:18 [INFO    ] DP 1: 22 lwa19
2012-08-08 18:05:18 [INFO    ] DP 1: 23 lwa21
2012-08-08 18:05:18 [INFO    ] DP 1: 24 lwa6
2012-08-08 18:05:18 [INFO    ] DP 1: 25 lwa7
2012-08-08 18:05:18 [INFO    ] DP 1: 26 lwa33
2012-08-08 18:05:18 [INFO    ] DP 1: 27 lwa15
2012-08-08 18:05:18 [INFO    ] DP 1: 28 lwa28
2012-08-08 18:05:18 [INFO    ] DP 2: 1 lwa16
2012-08-08 18:05:18 [INFO    ] DP 2: 15 lwa34
2012-08-08 18:05:18 [INFO    ] Total of 28 boards
2012-08-08 18:05:18 [INFO    ] Total of 260 stands
2012-08-08 18:05:18 [INFO    ] -------------------
2012-08-08 18:05:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8547
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8548
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8549
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8550
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8551
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8552
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8553
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8554
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8555
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8556
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8557
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8558
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8559
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8560
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8561
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8562
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8563
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8564
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8565
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8566
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8567
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8568
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8569
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8570
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8571
2012-08-08 18:05:25 [DEBUG   ] 2012-08-08 18:05:25 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8572
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8547 exited with status 0
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8548 exited with status 0
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8549 exited with status 0
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8550 exited with status 0
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8551 exited with status 0
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8552 exited with status 0
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8553 exited with status 0
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8554 exited with status 0
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8555 exited with status 0
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8556 exited with status 0
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8557 exited with status 0
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8558 exited with status 0
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8559 exited with status 0
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8560 exited with status 0
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8561 exited with status 0
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8562 exited with status 0
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8563 exited with status 0
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8564 exited with status 0
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8565 exited with status 0
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8566 exited with status 0
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8567 exited with status 0
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8568 exited with status 0
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8569 exited with status 0
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8570 exited with status 0
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8571 exited with status 0
2012-08-08 18:05:37 [DEBUG   ] 2012-08-08 18:05:37 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8572 exited with status 0
2012-08-08 18:05:37 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2012-08-08 18:05:37 [DEBUG   ] spawn_process: at 2012-08-08 18:05:37 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:37 [DEBUG   ] spawn_process: at 2012-08-08 18:05:37 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:37 [DEBUG   ] spawn_process: at 2012-08-08 18:05:37 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:37 [DEBUG   ] spawn_process: at 2012-08-08 18:05:37 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:37 [DEBUG   ] spawn_process: at 2012-08-08 18:05:37 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:37 [DEBUG   ] spawn_process: at 2012-08-08 18:05:37 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:37 [DEBUG   ] spawn_process: at 2012-08-08 18:05:37 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:37 [DEBUG   ] spawn_process: at 2012-08-08 18:05:37 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:37 [DEBUG   ] spawn_process: at 2012-08-08 18:05:37 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:37 [DEBUG   ] spawn_process: at 2012-08-08 18:05:37 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:37 [DEBUG   ] spawn_process: at 2012-08-08 18:05:37 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:37 [DEBUG   ] spawn_process: at 2012-08-08 18:05:37 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:37 [DEBUG   ] spawn_process: at 2012-08-08 18:05:37 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:38 [DEBUG   ] spawn_process: at 2012-08-08 18:05:38 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:38 [DEBUG   ] spawn_process: at 2012-08-08 18:05:38 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:38 [DEBUG   ] spawn_process: at 2012-08-08 18:05:38 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:38 [DEBUG   ] spawn_process: at 2012-08-08 18:05:38 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:38 [DEBUG   ] spawn_process: at 2012-08-08 18:05:38 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:38 [DEBUG   ] spawn_process: at 2012-08-08 18:05:38 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:38 [DEBUG   ] spawn_process: at 2012-08-08 18:05:38 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:38 [DEBUG   ] spawn_process: at 2012-08-08 18:05:38 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:38 [DEBUG   ] spawn_process: at 2012-08-08 18:05:38 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:38 [DEBUG   ] spawn_process: at 2012-08-08 18:05:38 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:38 [DEBUG   ] spawn_process: at 2012-08-08 18:05:38 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:38 [DEBUG   ] spawn_process: at 2012-08-08 18:05:38 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:38 [DEBUG   ] spawn_process: at 2012-08-08 18:05:38 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2012-08-08 18:05:38 [DEBUG   ] 2012-08-08 18:05:38 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 8599
2012-08-08 18:05:38 [DEBUG   ] 2012-08-08 18:05:38 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 8600
2012-08-08 18:05:43 [DEBUG   ] 2012-08-08 18:05:43 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 8599 exited with status 0
2012-08-08 18:05:43 [DEBUG   ] 2012-08-08 18:05:43 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 8600 exited with status 0
2012-08-08 18:05:43 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2012-08-08 18:05:43 [DEBUG   ] spawn_process: at 2012-08-08 18:05:43 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2012-08-08 18:05:43 [DEBUG   ] spawn_process: at 2012-08-08 18:05:43 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2012-08-08 18:05:43 [INFO    ] Setting Beam 1 xbars
2012-08-08 18:05:43 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2012-08-08 18:05:43 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2012-08-08 18:05:43 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2012-08-08 18:05:43 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2012-08-08 18:05:44 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2012-08-08 18:05:44 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2012-08-08 18:05:44 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2012-08-08 18:05:44 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2012-08-08 18:05:44 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2012-08-08 18:05:44 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2012-08-08 18:05:44 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2012-08-08 18:05:44 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2012-08-08 18:05:44 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2012-08-08 18:05:45 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2012-08-08 18:05:45 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2012-08-08 18:05:45 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2012-08-08 18:05:45 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2012-08-08 18:05:45 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2012-08-08 18:05:45 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2012-08-08 18:05:45 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2012-08-08 18:05:45 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2012-08-08 18:05:45 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2012-08-08 18:05:46 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2012-08-08 18:05:46 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2012-08-08 18:05:46 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2012-08-08 18:05:46 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2012-08-08 18:05:46 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2012-08-08 18:05:46 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2012-08-08 18:05:46 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2012-08-08 18:05:46 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2012-08-08 18:05:46 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2012-08-08 18:05:47 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2012-08-08 18:05:47 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2012-08-08 18:05:47 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2012-08-08 18:05:47 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2012-08-08 18:05:47 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2012-08-08 18:05:47 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2012-08-08 18:05:47 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2012-08-08 18:05:47 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2012-08-08 18:05:47 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2012-08-08 18:05:47 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2012-08-08 18:05:48 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2012-08-08 18:05:48 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2012-08-08 18:05:48 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2012-08-08 18:05:48 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2012-08-08 18:05:48 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2012-08-08 18:05:48 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2012-08-08 18:05:48 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2012-08-08 18:05:48 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2012-08-08 18:05:48 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2012-08-08 18:05:49 [INFO    ] Setting Beam 2 xbars
2012-08-08 18:05:49 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2012-08-08 18:05:49 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2012-08-08 18:05:49 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2012-08-08 18:05:49 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2012-08-08 18:05:49 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2012-08-08 18:05:49 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2012-08-08 18:05:49 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2012-08-08 18:05:49 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2012-08-08 18:05:49 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2012-08-08 18:05:50 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2012-08-08 18:05:50 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2012-08-08 18:05:50 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2012-08-08 18:05:50 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2012-08-08 18:05:50 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2012-08-08 18:05:50 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2012-08-08 18:05:50 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2012-08-08 18:05:50 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2012-08-08 18:05:50 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2012-08-08 18:05:51 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2012-08-08 18:05:51 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2012-08-08 18:05:51 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2012-08-08 18:05:51 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2012-08-08 18:05:51 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2012-08-08 18:05:51 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2012-08-08 18:05:51 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2012-08-08 18:05:51 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2012-08-08 18:05:51 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2012-08-08 18:05:52 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2012-08-08 18:05:52 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2012-08-08 18:05:52 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2012-08-08 18:05:52 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2012-08-08 18:05:52 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2012-08-08 18:05:52 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2012-08-08 18:05:52 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2012-08-08 18:05:52 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2012-08-08 18:05:52 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2012-08-08 18:05:52 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2012-08-08 18:05:53 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2012-08-08 18:05:53 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2012-08-08 18:05:53 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2012-08-08 18:05:53 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2012-08-08 18:05:53 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2012-08-08 18:05:53 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2012-08-08 18:05:53 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2012-08-08 18:05:53 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2012-08-08 18:05:53 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2012-08-08 18:05:54 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2012-08-08 18:05:54 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2012-08-08 18:05:54 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2012-08-08 18:05:54 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2012-08-08 18:05:54 [INFO    ] Setting Beam 3 xbars
2012-08-08 18:05:54 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2012-08-08 18:05:54 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2012-08-08 18:05:54 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2012-08-08 18:05:54 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2012-08-08 18:05:54 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2012-08-08 18:05:55 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2012-08-08 18:05:55 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2012-08-08 18:05:55 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2012-08-08 18:05:55 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2012-08-08 18:05:55 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2012-08-08 18:05:55 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2012-08-08 18:05:55 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2012-08-08 18:05:55 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2012-08-08 18:05:55 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2012-08-08 18:05:56 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2012-08-08 18:05:56 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2012-08-08 18:05:56 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2012-08-08 18:05:56 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2012-08-08 18:05:56 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2012-08-08 18:05:56 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2012-08-08 18:05:56 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2012-08-08 18:05:56 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2012-08-08 18:05:56 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2012-08-08 18:05:57 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2012-08-08 18:05:57 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2012-08-08 18:05:57 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2012-08-08 18:05:57 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2012-08-08 18:05:57 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2012-08-08 18:05:57 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2012-08-08 18:05:57 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2012-08-08 18:05:57 [DEBUG   ] Got command RPT from MCS: ref #6689
2012-08-08 18:05:57 [DEBUG   ] summary = BOOTING
2012-08-08 18:05:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6689  15 56147 65157717 ABOOTINGBOOTING'
2012-08-08 18:05:57 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2012-08-08 18:05:57 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2012-08-08 18:05:57 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2012-08-08 18:05:58 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2012-08-08 18:05:58 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2012-08-08 18:05:58 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2012-08-08 18:05:58 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2012-08-08 18:05:58 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2012-08-08 18:05:58 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2012-08-08 18:05:58 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2012-08-08 18:05:58 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2012-08-08 18:05:58 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2012-08-08 18:05:59 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2012-08-08 18:05:59 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2012-08-08 18:05:59 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2012-08-08 18:05:59 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2012-08-08 18:05:59 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2012-08-08 18:05:59 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2012-08-08 18:05:59 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2012-08-08 18:05:59 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2012-08-08 18:05:59 [INFO    ] Setting Beam 4 xbars
2012-08-08 18:05:59 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2012-08-08 18:06:00 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 18:06:00 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 18:06:00 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 18:06:00 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 18:06:00 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2012-08-08 18:06:00 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2012-08-08 18:06:00 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2012-08-08 18:06:00 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2012-08-08 18:06:00 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2012-08-08 18:06:01 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2012-08-08 18:06:01 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2012-08-08 18:06:01 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2012-08-08 18:06:01 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2012-08-08 18:06:01 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2012-08-08 18:06:01 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2012-08-08 18:06:01 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2012-08-08 18:06:01 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2012-08-08 18:06:01 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2012-08-08 18:06:02 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2012-08-08 18:06:02 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2012-08-08 18:06:02 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2012-08-08 18:06:02 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2012-08-08 18:06:02 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2012-08-08 18:06:02 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2012-08-08 18:06:02 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2012-08-08 18:06:02 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2012-08-08 18:06:02 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2012-08-08 18:06:02 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2012-08-08 18:06:03 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2012-08-08 18:06:03 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2012-08-08 18:06:03 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2012-08-08 18:06:03 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2012-08-08 18:06:03 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2012-08-08 18:06:03 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2012-08-08 18:06:03 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2012-08-08 18:06:03 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2012-08-08 18:06:03 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2012-08-08 18:06:04 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2012-08-08 18:06:04 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2012-08-08 18:06:04 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2012-08-08 18:06:04 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2012-08-08 18:06:04 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2012-08-08 18:06:04 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2012-08-08 18:06:04 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2012-08-08 18:06:04 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2012-08-08 18:06:04 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2012-08-08 18:06:05 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2012-08-08 18:06:05 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2012-08-08 18:06:05 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2012-08-08 18:06:05 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2012-08-08 18:06:05 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2012-08-08 18:06:05 [INFO    ] All xbars set
2012-08-08 18:06:05 [INFO    ] Setting adder chain routing for all beams
2012-08-08 18:06:10 [INFO    ] Setting beam ids
2012-08-08 18:06:20 [INFO    ] Starting beam delay calibration
2012-08-08 18:06:32 [INFO    ] Beam 1 latency is 5739
2012-08-08 18:06:32 [INFO    ] Beam 2 latency is 5768
2012-08-08 18:06:32 [INFO    ] Beam 3 latency is 5762
2012-08-08 18:06:32 [INFO    ] Beam 4 latency is 5741
2012-08-08 18:06:32 [INFO    ] Stop calibration
2012-08-08 18:06:40 [INFO    ] Beam delay calibration successful
2012-08-08 18:06:40 [INFO    ] Calibration passed
2012-08-08 18:06:40 [DEBUG   ] spawn_process: at 2012-08-08 18:06:40 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2012-08-08 18:06:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2012-08-08 18:06:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2012-08-08 18:06:40 [DEBUG   ] spawn_process: at 2012-08-08 18:06:40 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2012-08-08 18:06:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2012-08-08 18:06:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2012-08-08 18:06:40 [DEBUG   ] spawn_process: at 2012-08-08 18:06:40 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2012-08-08 18:06:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2012-08-08 18:06:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2012-08-08 18:06:40 [DEBUG   ] spawn_process: at 2012-08-08 18:06:40 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2012-08-08 18:06:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2012-08-08 18:06:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2012-08-08 18:06:41 [DEBUG   ] Finished updating ant stats in 0.543 seconds
2012-08-08 18:06:41 [INFO    ] Started antennas statistics background thread
2012-08-08 18:06:41 [INFO    ] Started board flags background thread
2012-08-08 18:06:41 [INFO    ] Started BAM background thread
2012-08-08 18:06:41 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 with PID 10194
2012-08-08 18:06:41 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 with PID 10197
2012-08-08 18:06:41 [INFO    ] Finished the INI process in 103.012 s
2012-08-08 18:06:42 [DEBUG   ] Finished updating board flags in 0.817 seconds
2012-08-08 18:06:58 [DEBUG   ] Got command RPT from MCS: ref #6690
2012-08-08 18:06:58 [DEBUG   ] summary = NORMAL
2012-08-08 18:06:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6690  14 56147 65218629 A NORMALNORMAL'
2012-08-08 18:07:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-08 18:07:21 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 18:07:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-08 18:07:42 [DEBUG   ] Finished updating board flags in 0.823 seconds
2012-08-08 18:07:45 [DEBUG   ] Got command TBN from MCS: ref #6695
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '1', '1344449266']
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '2', '1344449266']
2012-08-08 18:07:45 [DEBUG   ] tbn = exited with status True, code 0x00
2012-08-08 18:07:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN     6695   8 56147 65265045 A NORMAL'
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '3', '1344449266']
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '4', '1344449266']
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '5', '1344449266']
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '6', '1344449266']
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '7', '1344449266']
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '8', '1344449266']
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '9', '1344449266']
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '10', '1344449266']
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '11', '1344449266']
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '12', '1344449266']
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '13', '1344449266']
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '14', '1344449266']
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '15', '1344449266']
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '16', '1344449266']
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '17', '1344449266']
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '18', '1344449266']
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '19', '1344449266']
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '20', '1344449266']
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '21', '1344449266']
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '22', '1344449266']
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '23', '1344449266']
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '24', '1344449266']
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '25', '1344449266']
2012-08-08 18:07:45 [DEBUG   ] spawn_process: at 2012-08-08 18:07:45 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '26', '1344449266']
2012-08-08 18:07:45 [INFO    ] Finished spawning TBN in 0.047 s
2012-08-08 18:08:01 [DEBUG   ] Finished updating ant stats in 0.474 seconds
2012-08-08 18:08:22 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2012-08-08 18:08:42 [DEBUG   ] Finished updating ant stats in 1.249 seconds
2012-08-08 18:08:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 18:08:43 [DEBUG   ] Finished updating board flags in 1.358 seconds
2012-08-08 18:09:02 [DEBUG   ] Finished updating ant stats in 1.161 seconds
2012-08-08 18:09:06 [DEBUG   ] Got command RPT from MCS: ref #6696
2012-08-08 18:09:06 [DEBUG   ] summary = NORMAL
2012-08-08 18:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6696  14 56147 65346220 A NORMALNORMAL'
2012-08-08 18:09:06 [DEBUG   ] Got command RPT from MCS: ref #6697
2012-08-08 18:09:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 18:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6697  48 56147 65346221 A NORMALSystem calibrated and operating normally'
2012-08-08 18:09:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 18:09:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 18:09:42 [DEBUG   ] Finished updating ant stats in 1.040 seconds
2012-08-08 18:09:43 [DEBUG   ] Finished updating board flags in 1.287 seconds
2012-08-08 18:10:02 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2012-08-08 18:10:22 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-08 18:10:42 [DEBUG   ] Finished updating ant stats in 0.842 seconds
2012-08-08 18:10:43 [DEBUG   ] Finished updating board flags in 1.272 seconds
2012-08-08 18:11:02 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2012-08-08 18:11:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 18:11:42 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2012-08-08 18:11:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 18:11:43 [DEBUG   ] Finished updating board flags in 1.269 seconds
2012-08-08 18:12:02 [DEBUG   ] Finished updating ant stats in 0.561 seconds
2012-08-08 18:12:23 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2012-08-08 18:12:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 18:12:43 [DEBUG   ] Finished updating ant stats in 1.243 seconds
2012-08-08 18:12:43 [DEBUG   ] Finished updating board flags in 1.301 seconds
2012-08-08 18:13:03 [DEBUG   ] Finished updating ant stats in 1.164 seconds
2012-08-08 18:13:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 18:13:43 [DEBUG   ] Finished updating ant stats in 1.043 seconds
2012-08-08 18:13:43 [DEBUG   ] Finished updating board flags in 1.316 seconds
2012-08-08 18:14:03 [DEBUG   ] Finished updating ant stats in 0.965 seconds
2012-08-08 18:14:06 [DEBUG   ] Got command RPT from MCS: ref #6713
2012-08-08 18:14:06 [DEBUG   ] summary = NORMAL
2012-08-08 18:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6713  14 56147 65646228 A NORMALNORMAL'
2012-08-08 18:14:06 [DEBUG   ] Got command RPT from MCS: ref #6714
2012-08-08 18:14:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 18:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6714  48 56147 65646229 A NORMALSystem calibrated and operating normally'
2012-08-08 18:14:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 18:14:43 [DEBUG   ] Finished updating ant stats in 0.642 seconds
2012-08-08 18:14:43 [DEBUG   ] Finished updating board flags in 1.493 seconds
2012-08-08 18:15:03 [DEBUG   ] Finished updating ant stats in 0.565 seconds
2012-08-08 18:15:24 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2012-08-08 18:15:43 [DEBUG   ] Finished updating board flags in 1.436 seconds
2012-08-08 18:15:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 18:16:04 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-08 18:16:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 18:16:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 18:16:43 [DEBUG   ] Finished updating board flags in 1.445 seconds
2012-08-08 18:16:44 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2012-08-08 18:17:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 18:17:24 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-08 18:17:43 [DEBUG   ] Finished updating board flags in 1.413 seconds
2012-08-08 18:17:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 18:18:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 18:18:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 18:18:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-08 18:18:43 [DEBUG   ] Finished updating board flags in 1.445 seconds
2012-08-08 18:18:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 18:19:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 18:19:06 [DEBUG   ] Got command RPT from MCS: ref #6730
2012-08-08 18:19:06 [DEBUG   ] summary = NORMAL
2012-08-08 18:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6730  14 56147 65946229 A NORMALNORMAL'
2012-08-08 18:19:06 [DEBUG   ] Got command RPT from MCS: ref #6731
2012-08-08 18:19:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 18:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6731  48 56147 65946229 A NORMALSystem calibrated and operating normally'
2012-08-08 18:19:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-08 18:19:44 [DEBUG   ] Finished updating board flags in 1.444 seconds
2012-08-08 18:19:45 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-08 18:20:04 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-08 18:20:25 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2012-08-08 18:20:38 [DEBUG   ] Got command INI from MCS: ref #6747
2012-08-08 18:20:38 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2012-08-08 18:20:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI     6747   8 56147 66038548 ABOOTING'
2012-08-08 18:20:44 [DEBUG   ] Finished updating board flags in 1.599 seconds
2012-08-08 18:20:58 [INFO    ] -------------------
2012-08-08 18:20:58 [INFO    ]  LWA board status
2012-08-08 18:20:58 [INFO    ] -------------------
2012-08-08 18:20:58 [INFO    ] DP 1: 2 lwa27
2012-08-08 18:20:58 [INFO    ] DP 1: 3 lwa24
2012-08-08 18:20:58 [INFO    ] DP 1: 4 lwa23
2012-08-08 18:20:58 [INFO    ] DP 1: 5 lwa18
2012-08-08 18:20:58 [INFO    ] DP 1: 6 lwa10
2012-08-08 18:20:58 [INFO    ] DP 1: 7 lwa32
2012-08-08 18:20:58 [INFO    ] DP 1: 8 lwa11
2012-08-08 18:20:58 [INFO    ] DP 1: 9 lwa30
2012-08-08 18:20:58 [INFO    ] DP 1: 10 lwa12
2012-08-08 18:20:58 [INFO    ] DP 1: 11 lwa8
2012-08-08 18:20:58 [INFO    ] DP 1: 12 lwa13
2012-08-08 18:20:58 [INFO    ] DP 1: 13 lwa26
2012-08-08 18:20:58 [INFO    ] DP 1: 14 lwa14
2012-08-08 18:20:58 [INFO    ] DP 1: 16 lwa22
2012-08-08 18:20:58 [INFO    ] DP 1: 17 lwa20
2012-08-08 18:20:58 [INFO    ] DP 1: 18 lwa1
2012-08-08 18:20:58 [INFO    ] DP 1: 19 lwa5
2012-08-08 18:20:58 [INFO    ] DP 1: 20 lwa25
2012-08-08 18:20:58 [INFO    ] DP 1: 21 lwa35
2012-08-08 18:20:58 [INFO    ] DP 1: 22 lwa19
2012-08-08 18:20:58 [INFO    ] DP 1: 23 lwa21
2012-08-08 18:20:58 [INFO    ] DP 1: 24 lwa6
2012-08-08 18:20:58 [INFO    ] DP 1: 25 lwa7
2012-08-08 18:20:58 [INFO    ] DP 1: 26 lwa33
2012-08-08 18:20:58 [INFO    ] DP 1: 27 lwa15
2012-08-08 18:20:58 [INFO    ] DP 1: 28 lwa28
2012-08-08 18:20:58 [INFO    ] DP 2: 1 lwa16
2012-08-08 18:20:58 [INFO    ] DP 2: 15 lwa34
2012-08-08 18:20:58 [INFO    ] Total of 28 boards
2012-08-08 18:20:58 [INFO    ] Total of 260 stands
2012-08-08 18:20:58 [INFO    ] -------------------
2012-08-08 18:20:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2012-08-08 18:20:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2012-08-08 18:20:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2012-08-08 18:20:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2012-08-08 18:20:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2012-08-08 18:20:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2012-08-08 18:20:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2012-08-08 18:21:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2012-08-08 18:21:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2012-08-08 18:21:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2012-08-08 18:21:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2012-08-08 18:21:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2012-08-08 18:21:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2012-08-08 18:21:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2012-08-08 18:21:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2012-08-08 18:21:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2012-08-08 18:21:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2012-08-08 18:21:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2012-08-08 18:21:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2012-08-08 18:21:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2012-08-08 18:21:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2012-08-08 18:21:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2012-08-08 18:21:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2012-08-08 18:21:04 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2012-08-08 18:21:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2012-08-08 18:21:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2012-08-08 18:21:05 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2012-08-08 18:21:06 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12077
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12078
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12079
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12080
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12081
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12082
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12083
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12084
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12085
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12086
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12087
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12088
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12089
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12090
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12091
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12092
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12093
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12094
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12095
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12096
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12097
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12098
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12099
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12100
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12101
2012-08-08 18:21:06 [DEBUG   ] 2012-08-08 18:21:06 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12102
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12077 exited with status 0
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12078 exited with status 0
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12079 exited with status 0
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12080 exited with status 0
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12081 exited with status 0
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12082 exited with status 0
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12083 exited with status 0
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12084 exited with status 0
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12085 exited with status 0
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12086 exited with status 0
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12087 exited with status 0
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12088 exited with status 0
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12089 exited with status 0
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12090 exited with status 0
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12091 exited with status 0
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12092 exited with status 0
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12093 exited with status 0
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12094 exited with status 0
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12095 exited with status 0
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12096 exited with status 0
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12097 exited with status 0
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12098 exited with status 0
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12099 exited with status 0
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12100 exited with status 0
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12101 exited with status 0
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12102 exited with status 0
2012-08-08 18:21:18 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] spawn_process: at 2012-08-08 18:21:18 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 12129
2012-08-08 18:21:18 [DEBUG   ] 2012-08-08 18:21:18 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 12130
2012-08-08 18:21:24 [DEBUG   ] 2012-08-08 18:21:24 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 12129 exited with status 0
2012-08-08 18:21:24 [DEBUG   ] 2012-08-08 18:21:24 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 12130 exited with status 0
2012-08-08 18:21:24 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2012-08-08 18:21:24 [DEBUG   ] spawn_process: at 2012-08-08 18:21:24 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2012-08-08 18:21:24 [DEBUG   ] spawn_process: at 2012-08-08 18:21:24 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2012-08-08 18:21:24 [INFO    ] Setting Beam 1 xbars
2012-08-08 18:21:24 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2012-08-08 18:21:24 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2012-08-08 18:21:24 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2012-08-08 18:21:24 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2012-08-08 18:21:24 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2012-08-08 18:21:24 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2012-08-08 18:21:24 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2012-08-08 18:21:24 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2012-08-08 18:21:25 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2012-08-08 18:21:25 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2012-08-08 18:21:25 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2012-08-08 18:21:25 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2012-08-08 18:21:25 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2012-08-08 18:21:25 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2012-08-08 18:21:25 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2012-08-08 18:21:25 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2012-08-08 18:21:25 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2012-08-08 18:21:26 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2012-08-08 18:21:26 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2012-08-08 18:21:26 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2012-08-08 18:21:26 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2012-08-08 18:21:26 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2012-08-08 18:21:26 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2012-08-08 18:21:26 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2012-08-08 18:21:26 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2012-08-08 18:21:26 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2012-08-08 18:21:27 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2012-08-08 18:21:27 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2012-08-08 18:21:27 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2012-08-08 18:21:27 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2012-08-08 18:21:27 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2012-08-08 18:21:27 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2012-08-08 18:21:27 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2012-08-08 18:21:27 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2012-08-08 18:21:27 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2012-08-08 18:21:28 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2012-08-08 18:21:28 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2012-08-08 18:21:28 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2012-08-08 18:21:28 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2012-08-08 18:21:28 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2012-08-08 18:21:28 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2012-08-08 18:21:28 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2012-08-08 18:21:28 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2012-08-08 18:21:28 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2012-08-08 18:21:29 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2012-08-08 18:21:29 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2012-08-08 18:21:29 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2012-08-08 18:21:29 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2012-08-08 18:21:29 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2012-08-08 18:21:29 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2012-08-08 18:21:29 [INFO    ] Setting Beam 2 xbars
2012-08-08 18:21:29 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2012-08-08 18:21:29 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2012-08-08 18:21:29 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2012-08-08 18:21:30 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2012-08-08 18:21:30 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2012-08-08 18:21:30 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2012-08-08 18:21:30 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2012-08-08 18:21:30 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2012-08-08 18:21:30 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2012-08-08 18:21:30 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2012-08-08 18:21:30 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2012-08-08 18:21:30 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2012-08-08 18:21:31 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2012-08-08 18:21:31 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2012-08-08 18:21:31 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2012-08-08 18:21:31 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2012-08-08 18:21:31 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2012-08-08 18:21:31 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2012-08-08 18:21:31 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2012-08-08 18:21:31 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2012-08-08 18:21:31 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2012-08-08 18:21:31 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2012-08-08 18:21:32 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2012-08-08 18:21:32 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2012-08-08 18:21:32 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2012-08-08 18:21:32 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2012-08-08 18:21:32 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2012-08-08 18:21:32 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2012-08-08 18:21:32 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2012-08-08 18:21:32 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2012-08-08 18:21:32 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2012-08-08 18:21:33 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2012-08-08 18:21:33 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2012-08-08 18:21:33 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2012-08-08 18:21:33 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2012-08-08 18:21:33 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2012-08-08 18:21:33 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2012-08-08 18:21:33 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2012-08-08 18:21:33 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2012-08-08 18:21:33 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2012-08-08 18:21:34 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2012-08-08 18:21:34 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2012-08-08 18:21:34 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2012-08-08 18:21:34 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2012-08-08 18:21:34 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2012-08-08 18:21:34 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2012-08-08 18:21:34 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2012-08-08 18:21:34 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2012-08-08 18:21:34 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2012-08-08 18:21:35 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2012-08-08 18:21:35 [INFO    ] Setting Beam 3 xbars
2012-08-08 18:21:35 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2012-08-08 18:21:35 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2012-08-08 18:21:35 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2012-08-08 18:21:35 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2012-08-08 18:21:35 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2012-08-08 18:21:35 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2012-08-08 18:21:35 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2012-08-08 18:21:35 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2012-08-08 18:21:36 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2012-08-08 18:21:36 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2012-08-08 18:21:36 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2012-08-08 18:21:36 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2012-08-08 18:21:36 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2012-08-08 18:21:36 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2012-08-08 18:21:36 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2012-08-08 18:21:36 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2012-08-08 18:21:36 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2012-08-08 18:21:36 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2012-08-08 18:21:37 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2012-08-08 18:21:37 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2012-08-08 18:21:37 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2012-08-08 18:21:37 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2012-08-08 18:21:37 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2012-08-08 18:21:37 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2012-08-08 18:21:37 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2012-08-08 18:21:37 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2012-08-08 18:21:37 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2012-08-08 18:21:38 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2012-08-08 18:21:38 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2012-08-08 18:21:38 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2012-08-08 18:21:38 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2012-08-08 18:21:38 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2012-08-08 18:21:38 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2012-08-08 18:21:38 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2012-08-08 18:21:38 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2012-08-08 18:21:38 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2012-08-08 18:21:39 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2012-08-08 18:21:39 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2012-08-08 18:21:39 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2012-08-08 18:21:40 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2012-08-08 18:21:40 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2012-08-08 18:21:40 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2012-08-08 18:21:40 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2012-08-08 18:21:40 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2012-08-08 18:21:40 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2012-08-08 18:21:40 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2012-08-08 18:21:40 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2012-08-08 18:21:40 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2012-08-08 18:21:41 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2012-08-08 18:21:41 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2012-08-08 18:21:41 [INFO    ] Setting Beam 4 xbars
2012-08-08 18:21:41 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2012-08-08 18:21:41 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 18:21:41 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 18:21:41 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 18:21:41 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 18:21:41 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2012-08-08 18:21:41 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2012-08-08 18:21:42 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2012-08-08 18:21:42 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2012-08-08 18:21:42 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2012-08-08 18:21:42 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2012-08-08 18:21:42 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2012-08-08 18:21:42 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2012-08-08 18:21:42 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2012-08-08 18:21:42 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2012-08-08 18:21:42 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2012-08-08 18:21:43 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2012-08-08 18:21:43 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2012-08-08 18:21:43 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2012-08-08 18:21:43 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2012-08-08 18:21:43 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2012-08-08 18:21:43 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2012-08-08 18:21:43 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2012-08-08 18:21:43 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2012-08-08 18:21:43 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2012-08-08 18:21:44 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2012-08-08 18:21:44 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2012-08-08 18:21:44 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2012-08-08 18:21:44 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2012-08-08 18:21:44 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2012-08-08 18:21:44 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2012-08-08 18:21:44 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2012-08-08 18:21:44 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2012-08-08 18:21:44 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2012-08-08 18:21:45 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2012-08-08 18:21:45 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2012-08-08 18:21:45 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2012-08-08 18:21:45 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2012-08-08 18:21:45 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2012-08-08 18:21:45 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2012-08-08 18:21:45 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2012-08-08 18:21:45 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2012-08-08 18:21:45 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2012-08-08 18:21:45 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2012-08-08 18:21:46 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2012-08-08 18:21:46 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2012-08-08 18:21:46 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2012-08-08 18:21:46 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2012-08-08 18:21:46 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2012-08-08 18:21:46 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2012-08-08 18:21:46 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2012-08-08 18:21:46 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2012-08-08 18:21:46 [INFO    ] All xbars set
2012-08-08 18:21:46 [INFO    ] Setting adder chain routing for all beams
2012-08-08 18:21:51 [INFO    ] Setting beam ids
2012-08-08 18:22:01 [INFO    ] Starting beam delay calibration
2012-08-08 18:22:13 [INFO    ] Beam 1 latency is 5730
2012-08-08 18:22:13 [INFO    ] Beam 2 latency is 5769
2012-08-08 18:22:13 [INFO    ] Beam 3 latency is 5753
2012-08-08 18:22:13 [INFO    ] Beam 4 latency is 6680
2012-08-08 18:22:13 [INFO    ] Stop calibration
2012-08-08 18:22:22 [ERROR   ] Beam delay calibration failed
2012-08-08 18:22:22 [CRITICAL] Calibration failed
2012-08-08 18:22:22 [DEBUG   ] spawn_process: at 2012-08-08 18:22:22 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2012-08-08 18:22:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2012-08-08 18:22:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2012-08-08 18:22:22 [DEBUG   ] spawn_process: at 2012-08-08 18:22:22 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2012-08-08 18:22:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2012-08-08 18:22:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2012-08-08 18:22:22 [DEBUG   ] spawn_process: at 2012-08-08 18:22:22 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2012-08-08 18:22:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2012-08-08 18:22:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2012-08-08 18:22:22 [DEBUG   ] spawn_process: at 2012-08-08 18:22:22 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2012-08-08 18:22:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2012-08-08 18:22:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2012-08-08 18:22:23 [DEBUG   ] Finished updating ant stats in 0.659 seconds
2012-08-08 18:22:23 [INFO    ] Started antennas statistics background thread
2012-08-08 18:22:23 [INFO    ] Started board flags background thread
2012-08-08 18:22:23 [INFO    ] Started BAM background thread
2012-08-08 18:22:23 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 with PID 13721
2012-08-08 18:22:23 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 with PID 13724
2012-08-08 18:22:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 18:22:23 [INFO    ] Finished the INI process in 105.273 s
2012-08-08 18:22:24 [DEBUG   ] Finished updating board flags in 0.823 seconds
2012-08-08 18:22:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 18:22:44 [DEBUG   ] Got command RPT from MCS: ref #6748
2012-08-08 18:22:44 [DEBUG   ] summary = ERROR
2012-08-08 18:22:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6748  13 56147 66164409 A  ERRORERROR'
2012-08-08 18:22:51 [DEBUG   ] Got command INI from MCS: ref #6749
2012-08-08 18:22:51 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2012-08-08 18:22:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI     6749   8 56147 66171409 ABOOTING'
2012-08-08 18:23:08 [INFO    ] -------------------
2012-08-08 18:23:08 [INFO    ]  LWA board status
2012-08-08 18:23:08 [INFO    ] -------------------
2012-08-08 18:23:08 [INFO    ] DP 1: 2 lwa27
2012-08-08 18:23:08 [INFO    ] DP 1: 3 lwa24
2012-08-08 18:23:08 [INFO    ] DP 1: 4 lwa23
2012-08-08 18:23:08 [INFO    ] DP 1: 5 lwa18
2012-08-08 18:23:08 [INFO    ] DP 1: 6 lwa10
2012-08-08 18:23:08 [INFO    ] DP 1: 7 lwa32
2012-08-08 18:23:08 [INFO    ] DP 1: 8 lwa11
2012-08-08 18:23:08 [INFO    ] DP 1: 9 lwa30
2012-08-08 18:23:08 [INFO    ] DP 1: 10 lwa12
2012-08-08 18:23:08 [INFO    ] DP 1: 11 lwa8
2012-08-08 18:23:08 [INFO    ] DP 1: 12 lwa13
2012-08-08 18:23:08 [INFO    ] DP 1: 13 lwa26
2012-08-08 18:23:08 [INFO    ] DP 1: 14 lwa14
2012-08-08 18:23:08 [INFO    ] DP 1: 16 lwa22
2012-08-08 18:23:08 [INFO    ] DP 1: 17 lwa20
2012-08-08 18:23:08 [INFO    ] DP 1: 18 lwa1
2012-08-08 18:23:08 [INFO    ] DP 1: 19 lwa5
2012-08-08 18:23:08 [INFO    ] DP 1: 20 lwa25
2012-08-08 18:23:08 [INFO    ] DP 1: 21 lwa35
2012-08-08 18:23:08 [INFO    ] DP 1: 22 lwa19
2012-08-08 18:23:08 [INFO    ] DP 1: 23 lwa21
2012-08-08 18:23:08 [INFO    ] DP 1: 24 lwa6
2012-08-08 18:23:08 [INFO    ] DP 1: 25 lwa7
2012-08-08 18:23:08 [INFO    ] DP 1: 26 lwa33
2012-08-08 18:23:08 [INFO    ] DP 1: 27 lwa15
2012-08-08 18:23:08 [INFO    ] DP 1: 28 lwa28
2012-08-08 18:23:08 [INFO    ] DP 2: 1 lwa16
2012-08-08 18:23:08 [INFO    ] DP 2: 15 lwa34
2012-08-08 18:23:08 [INFO    ] Total of 28 boards
2012-08-08 18:23:08 [INFO    ] Total of 260 stands
2012-08-08 18:23:08 [INFO    ] -------------------
2012-08-08 18:23:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:09 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:11 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:12 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14075
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14076
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14077
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14078
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14079
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14080
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14081
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14082
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14083
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14084
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14085
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14086
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14087
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14088
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14089
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14090
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14091
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14092
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14093
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14094
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14095
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14096
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14097
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14098
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14099
2012-08-08 18:23:15 [DEBUG   ] 2012-08-08 18:23:15 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14100
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14075 exited with status 0
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14076 exited with status 0
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14077 exited with status 0
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14078 exited with status 0
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14079 exited with status 0
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14080 exited with status 0
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14081 exited with status 0
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14082 exited with status 0
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14083 exited with status 0
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14084 exited with status 0
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14085 exited with status 0
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14086 exited with status 0
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14087 exited with status 0
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14088 exited with status 0
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14089 exited with status 0
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14090 exited with status 0
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14091 exited with status 0
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14092 exited with status 0
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14093 exited with status 0
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14094 exited with status 0
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14095 exited with status 0
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14096 exited with status 0
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14097 exited with status 0
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14098 exited with status 0
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14099 exited with status 0
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14100 exited with status 0
2012-08-08 18:23:27 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] spawn_process: at 2012-08-08 18:23:27 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 14127
2012-08-08 18:23:27 [DEBUG   ] 2012-08-08 18:23:27 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 14128
2012-08-08 18:23:33 [DEBUG   ] 2012-08-08 18:23:33 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 14127 exited with status 0
2012-08-08 18:23:33 [DEBUG   ] 2012-08-08 18:23:33 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 14128 exited with status 0
2012-08-08 18:23:33 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2012-08-08 18:23:33 [DEBUG   ] spawn_process: at 2012-08-08 18:23:33 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2012-08-08 18:23:33 [DEBUG   ] spawn_process: at 2012-08-08 18:23:33 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2012-08-08 18:23:33 [INFO    ] Setting Beam 1 xbars
2012-08-08 18:23:33 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2012-08-08 18:23:33 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2012-08-08 18:23:33 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2012-08-08 18:23:33 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2012-08-08 18:23:33 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2012-08-08 18:23:34 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2012-08-08 18:23:34 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2012-08-08 18:23:34 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2012-08-08 18:23:34 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2012-08-08 18:23:34 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2012-08-08 18:23:34 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2012-08-08 18:23:34 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2012-08-08 18:23:34 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2012-08-08 18:23:34 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2012-08-08 18:23:35 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2012-08-08 18:23:35 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2012-08-08 18:23:35 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2012-08-08 18:23:35 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2012-08-08 18:23:35 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2012-08-08 18:23:35 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2012-08-08 18:23:35 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2012-08-08 18:23:35 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2012-08-08 18:23:35 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2012-08-08 18:23:36 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2012-08-08 18:23:36 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2012-08-08 18:23:36 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2012-08-08 18:23:36 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2012-08-08 18:23:36 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2012-08-08 18:23:36 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2012-08-08 18:23:36 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2012-08-08 18:23:36 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2012-08-08 18:23:36 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2012-08-08 18:23:37 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2012-08-08 18:23:37 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2012-08-08 18:23:37 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2012-08-08 18:23:37 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2012-08-08 18:23:37 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2012-08-08 18:23:37 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2012-08-08 18:23:37 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2012-08-08 18:23:37 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2012-08-08 18:23:37 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2012-08-08 18:23:37 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2012-08-08 18:23:38 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2012-08-08 18:23:38 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2012-08-08 18:23:38 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2012-08-08 18:23:38 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2012-08-08 18:23:38 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2012-08-08 18:23:38 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2012-08-08 18:23:38 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2012-08-08 18:23:38 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2012-08-08 18:23:38 [INFO    ] Setting Beam 2 xbars
2012-08-08 18:23:38 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2012-08-08 18:23:39 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2012-08-08 18:23:39 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2012-08-08 18:23:39 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2012-08-08 18:23:39 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2012-08-08 18:23:39 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2012-08-08 18:23:39 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2012-08-08 18:23:39 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2012-08-08 18:23:39 [DEBUG   ] Got command RPT from MCS: ref #6750
2012-08-08 18:23:39 [DEBUG   ] summary = BOOTING
2012-08-08 18:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6750  15 56147 66219741 ABOOTINGBOOTING'
2012-08-08 18:23:39 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2012-08-08 18:23:39 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2012-08-08 18:23:40 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2012-08-08 18:23:40 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2012-08-08 18:23:40 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2012-08-08 18:23:40 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2012-08-08 18:23:40 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2012-08-08 18:23:40 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2012-08-08 18:23:40 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2012-08-08 18:23:40 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2012-08-08 18:23:40 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2012-08-08 18:23:41 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2012-08-08 18:23:41 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2012-08-08 18:23:41 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2012-08-08 18:23:41 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2012-08-08 18:23:41 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2012-08-08 18:23:41 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2012-08-08 18:23:41 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2012-08-08 18:23:41 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2012-08-08 18:23:41 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2012-08-08 18:23:42 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2012-08-08 18:23:42 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2012-08-08 18:23:42 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2012-08-08 18:23:42 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2012-08-08 18:23:42 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2012-08-08 18:23:42 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2012-08-08 18:23:42 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2012-08-08 18:23:42 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2012-08-08 18:23:42 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2012-08-08 18:23:42 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2012-08-08 18:23:43 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2012-08-08 18:23:43 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2012-08-08 18:23:43 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2012-08-08 18:23:43 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2012-08-08 18:23:43 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2012-08-08 18:23:43 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2012-08-08 18:23:43 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2012-08-08 18:23:43 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2012-08-08 18:23:43 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2012-08-08 18:23:44 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2012-08-08 18:23:44 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2012-08-08 18:23:44 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2012-08-08 18:23:44 [INFO    ] Setting Beam 3 xbars
2012-08-08 18:23:44 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2012-08-08 18:23:44 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2012-08-08 18:23:44 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2012-08-08 18:23:44 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2012-08-08 18:23:44 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2012-08-08 18:23:44 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2012-08-08 18:23:45 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2012-08-08 18:23:45 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2012-08-08 18:23:45 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2012-08-08 18:23:45 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2012-08-08 18:23:45 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2012-08-08 18:23:45 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2012-08-08 18:23:45 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2012-08-08 18:23:45 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2012-08-08 18:23:45 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2012-08-08 18:23:46 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2012-08-08 18:23:46 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2012-08-08 18:23:46 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2012-08-08 18:23:46 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2012-08-08 18:23:46 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2012-08-08 18:23:46 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2012-08-08 18:23:46 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2012-08-08 18:23:46 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2012-08-08 18:23:46 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2012-08-08 18:23:47 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2012-08-08 18:23:47 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2012-08-08 18:23:47 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2012-08-08 18:23:47 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2012-08-08 18:23:47 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2012-08-08 18:23:47 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2012-08-08 18:23:47 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2012-08-08 18:23:47 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2012-08-08 18:23:47 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2012-08-08 18:23:48 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2012-08-08 18:23:48 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2012-08-08 18:23:48 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2012-08-08 18:23:48 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2012-08-08 18:23:48 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2012-08-08 18:23:48 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2012-08-08 18:23:48 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2012-08-08 18:23:48 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2012-08-08 18:23:48 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2012-08-08 18:23:48 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2012-08-08 18:23:49 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2012-08-08 18:23:49 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2012-08-08 18:23:49 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2012-08-08 18:23:49 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2012-08-08 18:23:49 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2012-08-08 18:23:49 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2012-08-08 18:23:49 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2012-08-08 18:23:49 [INFO    ] Setting Beam 4 xbars
2012-08-08 18:23:49 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2012-08-08 18:23:49 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 18:23:50 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 18:23:50 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 18:23:50 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 18:23:50 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2012-08-08 18:23:50 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2012-08-08 18:23:50 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2012-08-08 18:23:50 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2012-08-08 18:23:50 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2012-08-08 18:23:50 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2012-08-08 18:23:51 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2012-08-08 18:23:51 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2012-08-08 18:23:51 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2012-08-08 18:23:51 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2012-08-08 18:23:51 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2012-08-08 18:23:51 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2012-08-08 18:23:51 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2012-08-08 18:23:51 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2012-08-08 18:23:51 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2012-08-08 18:23:52 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2012-08-08 18:23:52 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2012-08-08 18:23:52 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2012-08-08 18:23:52 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2012-08-08 18:23:52 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2012-08-08 18:23:52 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2012-08-08 18:23:52 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2012-08-08 18:23:52 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2012-08-08 18:23:52 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2012-08-08 18:23:53 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2012-08-08 18:23:53 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2012-08-08 18:23:53 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2012-08-08 18:23:53 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2012-08-08 18:23:53 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2012-08-08 18:23:53 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2012-08-08 18:23:53 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2012-08-08 18:23:53 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2012-08-08 18:23:53 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2012-08-08 18:23:54 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2012-08-08 18:23:54 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2012-08-08 18:23:54 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2012-08-08 18:23:54 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2012-08-08 18:23:54 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2012-08-08 18:23:54 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2012-08-08 18:23:54 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2012-08-08 18:23:54 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2012-08-08 18:23:54 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2012-08-08 18:23:55 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2012-08-08 18:23:55 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2012-08-08 18:23:55 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2012-08-08 18:23:55 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2012-08-08 18:23:55 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2012-08-08 18:23:55 [INFO    ] All xbars set
2012-08-08 18:23:55 [INFO    ] Setting adder chain routing for all beams
2012-08-08 18:24:00 [INFO    ] Setting beam ids
2012-08-08 18:24:01 [DEBUG   ] Got command RPT from MCS: ref #6751
2012-08-08 18:24:01 [DEBUG   ] summary = BOOTING
2012-08-08 18:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6751  15 56147 66241425 ABOOTINGBOOTING'
2012-08-08 18:24:06 [DEBUG   ] Got command RPT from MCS: ref #6752
2012-08-08 18:24:06 [DEBUG   ] summary = BOOTING
2012-08-08 18:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6752  15 56147 66246224 ABOOTINGBOOTING'
2012-08-08 18:24:06 [DEBUG   ] Got command RPT from MCS: ref #6753
2012-08-08 18:24:06 [DEBUG   ] info = Starting calibration
2012-08-08 18:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6753  28 56147 66246225 ABOOTINGStarting calibration'
2012-08-08 18:24:10 [INFO    ] Starting beam delay calibration
2012-08-08 18:24:10 [DEBUG   ] Got command RPT from MCS: ref #6769
2012-08-08 18:24:10 [DEBUG   ] summary = BOOTING
2012-08-08 18:24:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6769  15 56147 66250833 ABOOTINGBOOTING'
2012-08-08 18:24:22 [INFO    ] Beam 1 latency is 5730
2012-08-08 18:24:22 [INFO    ] Beam 2 latency is 5759
2012-08-08 18:24:22 [INFO    ] Beam 3 latency is 5752
2012-08-08 18:24:22 [INFO    ] Beam 4 latency is 5728
2012-08-08 18:24:22 [INFO    ] Stop calibration
2012-08-08 18:24:30 [INFO    ] Beam delay calibration successful
2012-08-08 18:24:30 [INFO    ] Calibration passed
2012-08-08 18:24:30 [DEBUG   ] spawn_process: at 2012-08-08 18:24:30 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2012-08-08 18:24:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2012-08-08 18:24:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2012-08-08 18:24:30 [DEBUG   ] spawn_process: at 2012-08-08 18:24:30 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2012-08-08 18:24:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2012-08-08 18:24:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2012-08-08 18:24:30 [DEBUG   ] spawn_process: at 2012-08-08 18:24:30 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2012-08-08 18:24:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2012-08-08 18:24:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2012-08-08 18:24:30 [DEBUG   ] spawn_process: at 2012-08-08 18:24:30 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2012-08-08 18:24:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2012-08-08 18:24:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2012-08-08 18:24:31 [DEBUG   ] Finished updating ant stats in 0.660 seconds
2012-08-08 18:24:31 [INFO    ] Started antennas statistics background thread
2012-08-08 18:24:31 [INFO    ] Started board flags background thread
2012-08-08 18:24:31 [INFO    ] Started BAM background thread
2012-08-08 18:24:31 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 with PID 15723
2012-08-08 18:24:31 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 with PID 15726
2012-08-08 18:24:31 [INFO    ] Finished the INI process in 100.412 s
2012-08-08 18:24:32 [DEBUG   ] Finished updating board flags in 0.816 seconds
2012-08-08 18:24:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 18:25:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 18:25:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 18:25:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 18:25:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-08 18:25:32 [DEBUG   ] Finished updating board flags in 0.825 seconds
2012-08-08 18:25:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 18:26:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 18:26:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 18:26:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 18:26:32 [DEBUG   ] Finished updating board flags in 0.862 seconds
2012-08-08 18:26:33 [DEBUG   ] Got command RPT from MCS: ref #6770
2012-08-08 18:26:33 [DEBUG   ] summary = NORMAL
2012-08-08 18:26:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6770  14 56147 66393173 A NORMALNORMAL'
2012-08-08 18:26:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 18:27:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 18:27:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 18:27:32 [DEBUG   ] Finished updating board flags in 0.961 seconds
2012-08-08 18:27:39 [DEBUG   ] Got command DRX from MCS: ref #6775
2012-08-08 18:27:39 [INFO    ] sending drx command to lwa34
2012-08-08 18:27:39 [DEBUG   ] run_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa34', '/lwa/software/drx 5 1 37900000.0 7 8 0']
2012-08-08 18:27:39 [DEBUG   ] drx = exited with status True, code 0x00
2012-08-08 18:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     6775   8 56147 66459553 A NORMAL'
2012-08-08 18:27:39 [DEBUG   ] Got command DRX from MCS: ref #6776
2012-08-08 18:27:39 [INFO    ] sending drx command to lwa34
2012-08-08 18:27:39 [DEBUG   ] run_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa34', '/lwa/software/drx 5 2 74030000.0 7 8 0']
2012-08-08 18:27:39 [DEBUG   ] drx = exited with status True, code 0x00
2012-08-08 18:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     6776   8 56147 66459557 A NORMAL'
2012-08-08 18:27:39 [INFO    ] Finished starting DRX
2012-08-08 18:27:39 [INFO    ] Finished starting DRX
2012-08-08 18:27:39 [DEBUG   ] Got command BAM from MCS: ref #6777
2012-08-08 18:27:39 [INFO    ] Finished processing BAM request
2012-08-08 18:27:39 [DEBUG   ] bam = exited with status True, code 0x00
2012-08-08 18:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6777   8 56147 66459608 A NORMAL'
2012-08-08 18:27:39 [DEBUG   ] Got command DRX from MCS: ref #6778
2012-08-08 18:27:39 [INFO    ] sending drx command to lwa34
2012-08-08 18:27:39 [DEBUG   ] run_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 37900000.0 7 8 0']
2012-08-08 18:27:39 [DEBUG   ] drx = exited with status True, code 0x00
2012-08-08 18:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     6778   8 56147 66459721 A NORMAL'
2012-08-08 18:27:39 [INFO    ] Finished starting DRX
2012-08-08 18:27:39 [DEBUG   ] Got command DRX from MCS: ref #6779
2012-08-08 18:27:39 [INFO    ] sending drx command to lwa34
2012-08-08 18:27:39 [DEBUG   ] run_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 74030000.0 7 8 0']
2012-08-08 18:27:39 [DEBUG   ] drx = exited with status True, code 0x00
2012-08-08 18:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     6779   8 56147 66459797 A NORMAL'
2012-08-08 18:27:39 [DEBUG   ] Got command BAM from MCS: ref #6780
2012-08-08 18:27:39 [INFO    ] Finished processing BAM request
2012-08-08 18:27:39 [DEBUG   ] bam = exited with status True, code 0x00
2012-08-08 18:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6780   8 56147 66459812 A NORMAL'
2012-08-08 18:27:39 [INFO    ] Finished starting DRX
2012-08-08 18:27:39 [DEBUG   ] Got command DRX from MCS: ref #6781
2012-08-08 18:27:39 [INFO    ] sending drx command to lwa16
2012-08-08 18:27:39 [DEBUG   ] run_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 37900000.0 7 8 0']
2012-08-08 18:27:39 [DEBUG   ] drx = exited with status True, code 0x00
2012-08-08 18:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     6781   8 56147 66459857 A NORMAL'
2012-08-08 18:27:39 [DEBUG   ] Got command DRX from MCS: ref #6782
2012-08-08 18:27:39 [INFO    ] sending drx command to lwa16
2012-08-08 18:27:39 [DEBUG   ] run_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 74030000.0 7 8 0']
2012-08-08 18:27:39 [DEBUG   ] drx = exited with status True, code 0x00
2012-08-08 18:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     6782   8 56147 66459865 A NORMAL'
2012-08-08 18:27:39 [DEBUG   ] Got command BAM from MCS: ref #6783
2012-08-08 18:27:39 [INFO    ] Finished processing BAM request
2012-08-08 18:27:39 [INFO    ] Finished starting DRX
2012-08-08 18:27:39 [DEBUG   ] bam = exited with status True, code 0x00
2012-08-08 18:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6783   8 56147 66459888 A NORMAL'
2012-08-08 18:27:39 [INFO    ] Finished starting DRX
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2012-08-08 18:27:39 [DEBUG   ] Got command DRX from MCS: ref #6784
2012-08-08 18:27:39 [INFO    ] sending drx command to lwa16
2012-08-08 18:27:39 [DEBUG   ] run_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 1 37900000.0 7 8 0']
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2012-08-08 18:27:39 [DEBUG   ] drx = exited with status True, code 0x00
2012-08-08 18:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     6784   8 56147 66459949 A NORMAL'
2012-08-08 18:27:39 [DEBUG   ] Got command DRX from MCS: ref #6785
2012-08-08 18:27:39 [INFO    ] sending drx command to lwa16
2012-08-08 18:27:39 [DEBUG   ] run_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 2 74030000.0 7 8 0']
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2012-08-08 18:27:39 [DEBUG   ] drx = exited with status True, code 0x00
2012-08-08 18:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     6785   8 56147 66459957 A NORMAL'
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2012-08-08 18:27:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2012-08-08 18:27:39 [DEBUG   ] spawn_process: at 2012-08-08 18:27:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2012-08-08 18:27:39 [DEBUG   ] Got command BAM from MCS: ref #6786
2012-08-08 18:27:39 [INFO    ] Finished processing BAM request
2012-08-08 18:27:39 [DEBUG   ] bam = exited with status True, code 0x00
2012-08-08 18:27:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     6786   8 56147 66459976 A NORMAL'
2012-08-08 18:27:39 [INFO    ] Finished starting DRX
2012-08-08 18:27:39 [INFO    ] Finished starting DRX
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2012-08-08 18:27:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2012-08-08 18:27:40 [DEBUG   ] spawn_process: at 2012-08-08 18:27:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2012-08-08 18:27:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 18:28:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 18:28:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 18:28:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 18:28:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 18:28:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 18:28:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:28:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 18:28:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 18:28:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 18:28:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 18:28:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 2
2012-08-08 18:28:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 18:28:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 18:28:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:28:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 18:28:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 18:28:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 18:28:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 18:28:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 18:28:32 [DEBUG   ] Finished updating board flags in 1.140 seconds
2012-08-08 18:28:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 18:29:06 [DEBUG   ] Got command RPT from MCS: ref #6791
2012-08-08 18:29:06 [DEBUG   ] summary = NORMAL
2012-08-08 18:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6791  14 56147 66546225 A NORMALNORMAL'
2012-08-08 18:29:06 [DEBUG   ] Got command RPT from MCS: ref #6792
2012-08-08 18:29:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 18:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6792  48 56147 66546225 A NORMALSystem calibrated and operating normally'
2012-08-08 18:29:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 18:29:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 18:29:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 18:29:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 18:29:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 18:29:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 18:29:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 18:29:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 18:29:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:29:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 18:29:32 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa30, chip 2
2012-08-08 18:29:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 18:29:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 18:29:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:29:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 18:29:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 18:29:32 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 18:29:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-08 18:29:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 18:29:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 18:29:32 [DEBUG   ] Finished updating board flags in 0.917 seconds
2012-08-08 18:29:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 18:30:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 18:30:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 18:30:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 18:30:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 18:30:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 18:30:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 18:30:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 18:30:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:30:32 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 18:30:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 18:30:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 18:30:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 18:30:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 18:30:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-08 18:30:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:30:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 18:30:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:30:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 18:30:32 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-08 18:30:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 18:30:33 [DEBUG   ] Finished updating board flags in 0.919 seconds
2012-08-08 18:30:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 18:31:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 18:31:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 18:31:32 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-08 18:31:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 18:31:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 18:31:32 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 18:31:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 18:31:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:31:32 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 18:31:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 18:31:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 18:31:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 18:31:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 18:31:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-08 18:31:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:31:32 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2012-08-08 18:31:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 18:31:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 18:31:33 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa33, chip 2
2012-08-08 18:31:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 18:31:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2012-08-08 18:31:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 18:31:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 18:31:33 [DEBUG   ] Finished updating board flags in 0.922 seconds
2012-08-08 18:31:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 18:32:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 18:32:31 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2012-08-08 18:32:32 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa27, chip 2
2012-08-08 18:32:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 18:32:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 18:32:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 18:32:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 18:32:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 18:32:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:32:32 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa30, chip 2
2012-08-08 18:32:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 18:32:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 1
2012-08-08 18:32:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 18:32:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 18:32:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 18:32:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 18:32:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 1
2012-08-08 18:32:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:32:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 18:32:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 18:32:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:32:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 18:32:33 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2012-08-08 18:32:33 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa33, chip 2
2012-08-08 18:32:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 3
2012-08-08 18:32:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-08 18:32:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 18:32:33 [DEBUG   ] Finished updating board flags in 1.089 seconds
2012-08-08 18:32:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 18:33:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 18:33:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 18:33:32 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa27, chip 2
2012-08-08 18:33:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 18:33:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 18:33:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 18:33:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 18:33:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:33:32 [WARNING ] MonitorFlags: Temperature 83.70 > 80 on hostname lwa30, chip 2
2012-08-08 18:33:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 18:33:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:33:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 18:33:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:33:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 18:33:33 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-08 18:33:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 18:33:33 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa33, chip 2
2012-08-08 18:33:33 [DEBUG   ] Finished updating board flags in 0.880 seconds
2012-08-08 18:33:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 18:34:06 [DEBUG   ] Got command RPT from MCS: ref #6808
2012-08-08 18:34:06 [DEBUG   ] summary = WARNING
2012-08-08 18:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6808  15 56147 66846237 AWARNINGWARNING'
2012-08-08 18:34:06 [DEBUG   ] Got command RPT from MCS: ref #6809
2012-08-08 18:34:06 [DEBUG   ] info = BOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD2_TEMP_MAX BOARD23_TEMP_MAX! 0x01! Multiple board temperature warnings - 4 boards
2012-08-08 18:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6809 127 56147 66846237 AWARNINGBOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD2_TEMP_MAX BOARD23_TEMP_MAX! 0x01! Multiple board temperature warnings - 4 boards'
2012-08-08 18:34:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 18:34:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 18:34:32 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa27, chip 2
2012-08-08 18:34:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 18:34:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 3
2012-08-08 18:34:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 18:34:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 18:34:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:34:32 [WARNING ] MonitorFlags: Temperature 84.20 > 80 on hostname lwa30, chip 2
2012-08-08 18:34:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 18:34:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 18:34:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 18:34:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 18:34:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:34:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 18:34:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 18:34:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-08 18:34:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:34:33 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-08 18:34:33 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-08 18:34:33 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa33, chip 2
2012-08-08 18:34:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2012-08-08 18:34:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 18:34:33 [DEBUG   ] Finished updating board flags in 0.900 seconds
2012-08-08 18:34:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 18:35:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 18:35:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 18:35:32 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa27, chip 2
2012-08-08 18:35:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 18:35:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 18:35:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 18:35:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 18:35:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-08 18:35:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 18:35:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 18:35:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 2
2012-08-08 18:35:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:35:32 [WARNING ] MonitorFlags: Temperature 84.70 > 80 on hostname lwa30, chip 2
2012-08-08 18:35:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 18:35:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 18:35:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 18:35:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 18:35:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2012-08-08 18:35:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 18:35:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:35:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 18:35:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 18:35:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 18:35:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:35:33 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2012-08-08 18:35:33 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-08 18:35:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-08 18:35:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 18:35:33 [WARNING ] MonitorFlags: Temperature 83.70 > 80 on hostname lwa33, chip 2
2012-08-08 18:35:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-08 18:35:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 18:35:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 18:35:33 [DEBUG   ] Finished updating board flags in 0.900 seconds
2012-08-08 18:35:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 18:36:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 18:36:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 18:36:32 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa27, chip 2
2012-08-08 18:36:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 18:36:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 18:36:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 3
2012-08-08 18:36:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 18:36:32 [WARNING ] MonitorFlags: Temperature 84.70 > 80 on hostname lwa30, chip 2
2012-08-08 18:36:32 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 18:36:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-08 18:36:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 18:36:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 18:36:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 18:36:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 18:36:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 18:36:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-08 18:36:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:36:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 18:36:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 18:36:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:36:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 18:36:33 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-08 18:36:33 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-08 18:36:33 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa33, chip 2
2012-08-08 18:36:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 2
2012-08-08 18:36:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2012-08-08 18:36:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 18:36:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 18:36:33 [DEBUG   ] Finished updating board flags in 0.902 seconds
2012-08-08 18:36:51 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2012-08-08 18:37:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 18:37:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 18:37:32 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa27, chip 2
2012-08-08 18:37:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 18:37:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 18:37:33 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 18:37:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:37:33 [WARNING ] MonitorFlags: Temperature 84.70 > 80 on hostname lwa30, chip 2
2012-08-08 18:37:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 18:37:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 18:37:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 18:37:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 18:37:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-08 18:37:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 18:37:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:37:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 18:37:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:37:33 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-08 18:37:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 18:37:33 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-08 18:37:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 18:37:33 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa33, chip 2
2012-08-08 18:37:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-08 18:37:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 18:37:33 [DEBUG   ] Finished updating board flags in 0.902 seconds
2012-08-08 18:37:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-08 18:38:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 18:38:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 18:38:32 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa27, chip 2
2012-08-08 18:38:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 18:38:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 18:38:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 18:38:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:38:33 [WARNING ] MonitorFlags: Temperature 84.70 > 80 on hostname lwa30, chip 2
2012-08-08 18:38:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 18:38:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:38:33 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-08 18:38:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-08 18:38:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 18:38:33 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa33, chip 2
2012-08-08 18:38:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 2
2012-08-08 18:38:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 18:38:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 18:38:33 [DEBUG   ] Finished updating board flags in 1.085 seconds
2012-08-08 18:38:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 18:39:06 [DEBUG   ] Got command RPT from MCS: ref #6825
2012-08-08 18:39:06 [DEBUG   ] summary = WARNING
2012-08-08 18:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6825  15 56147 67146233 AWARNINGWARNING'
2012-08-08 18:39:06 [DEBUG   ] Got command RPT from MCS: ref #6826
2012-08-08 18:39:06 [DEBUG   ] info = BOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD2_TEMP_MAX BOARD23_TEMP_MAX! 0x01! Multiple board temperature warnings - 4 boards
2012-08-08 18:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6826 127 56147 67146233 AWARNINGBOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD2_TEMP_MAX BOARD23_TEMP_MAX! 0x01! Multiple board temperature warnings - 4 boards'
2012-08-08 18:39:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 18:39:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 18:39:33 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa27, chip 2
2012-08-08 18:39:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 18:39:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 18:39:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 18:39:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:39:33 [WARNING ] MonitorFlags: Temperature 84.20 > 80 on hostname lwa30, chip 2
2012-08-08 18:39:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-08 18:39:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 18:39:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 18:39:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 18:39:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:39:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 18:39:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 18:39:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:39:33 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-08 18:39:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 18:39:33 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa33, chip 2
2012-08-08 18:39:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 2
2012-08-08 18:39:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-08 18:39:33 [DEBUG   ] Finished updating board flags in 0.921 seconds
2012-08-08 18:39:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 18:40:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 18:40:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 18:40:33 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa27, chip 2
2012-08-08 18:40:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 18:40:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 18:40:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2012-08-08 18:40:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 18:40:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 18:40:33 [WARNING ] MonitorFlags: Temperature 83.70 > 80 on hostname lwa30, chip 2
2012-08-08 18:40:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 18:40:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 18:40:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-08 18:40:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 18:40:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2012-08-08 18:40:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:40:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 18:40:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 18:40:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 3
2012-08-08 18:40:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 18:40:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:40:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 18:40:33 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2012-08-08 18:40:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 1
2012-08-08 18:40:33 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa33, chip 2
2012-08-08 18:40:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-08 18:40:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 18:40:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 18:40:34 [DEBUG   ] Finished updating board flags in 0.906 seconds
2012-08-08 18:40:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 18:41:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 18:41:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 18:41:33 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa27, chip 2
2012-08-08 18:41:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 18:41:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 18:41:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 18:41:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 18:41:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:41:33 [WARNING ] MonitorFlags: Temperature 83.70 > 80 on hostname lwa30, chip 2
2012-08-08 18:41:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 18:41:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 18:41:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-08 18:41:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 18:41:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2012-08-08 18:41:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:41:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 18:41:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 18:41:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 18:41:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:41:33 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2012-08-08 18:41:34 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa33, chip 2
2012-08-08 18:41:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2012-08-08 18:41:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 18:41:34 [DEBUG   ] Finished updating board flags in 0.912 seconds
2012-08-08 18:41:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 18:42:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 18:42:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 18:42:33 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa27, chip 2
2012-08-08 18:42:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 18:42:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 18:42:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 18:42:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 18:42:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 18:42:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 18:42:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:42:33 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa30, chip 2
2012-08-08 18:42:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 18:42:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 18:42:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 18:42:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:42:34 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2012-08-08 18:42:34 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa33, chip 2
2012-08-08 18:42:34 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa33, chip 2
2012-08-08 18:42:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 18:42:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 18:42:34 [DEBUG   ] Finished updating board flags in 1.095 seconds
2012-08-08 18:42:52 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 18:43:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 18:43:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:43:33 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa27, chip 2
2012-08-08 18:43:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 18:43:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 18:43:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 18:43:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 18:43:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:43:33 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 18:43:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 18:43:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 2
2012-08-08 18:43:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:43:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 18:43:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 18:43:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:43:34 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2012-08-08 18:43:34 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa33, chip 2
2012-08-08 18:43:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 18:43:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 18:43:34 [DEBUG   ] Finished updating board flags in 0.902 seconds
2012-08-08 18:43:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:44:06 [DEBUG   ] Got command RPT from MCS: ref #6842
2012-08-08 18:44:06 [DEBUG   ] summary = WARNING
2012-08-08 18:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6842  15 56147 67446241 AWARNINGWARNING'
2012-08-08 18:44:06 [DEBUG   ] Got command RPT from MCS: ref #6843
2012-08-08 18:44:06 [DEBUG   ] info = BOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD2_TEMP_MAX BOARD23_TEMP_MAX! 0x01! Multiple board temperature warnings - 4 boards
2012-08-08 18:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6843 127 56147 67446241 AWARNINGBOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD2_TEMP_MAX BOARD23_TEMP_MAX! 0x01! Multiple board temperature warnings - 4 boards'
2012-08-08 18:44:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 18:44:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 18:44:33 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa27, chip 2
2012-08-08 18:44:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 18:44:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 18:44:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 18:44:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 18:44:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 18:44:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:44:33 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 18:44:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 18:44:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:44:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 18:44:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:44:34 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2012-08-08 18:44:34 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa33, chip 2
2012-08-08 18:44:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-08 18:44:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 18:44:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 18:44:34 [DEBUG   ] Finished updating board flags in 0.898 seconds
2012-08-08 18:44:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:45:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:45:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:45:33 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa27, chip 2
2012-08-08 18:45:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 18:45:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 18:45:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 18:45:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 18:45:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:45:33 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 18:45:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 18:45:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 18:45:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 18:45:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-08 18:45:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:45:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 18:45:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 18:45:34 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa33, chip 2
2012-08-08 18:45:34 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 18:45:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 18:45:34 [DEBUG   ] Finished updating board flags in 0.902 seconds
2012-08-08 18:45:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:46:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:46:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:46:33 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa27, chip 2
2012-08-08 18:46:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 18:46:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 18:46:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 18:46:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 18:46:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 18:46:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 4
2012-08-08 18:46:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:46:33 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 18:46:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 18:46:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 18:46:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 18:46:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 18:46:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 18:46:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2012-08-08 18:46:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 18:46:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 18:46:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 18:46:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 18:46:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:46:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 18:46:34 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa33, chip 2
2012-08-08 18:46:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 2
2012-08-08 18:46:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-08 18:46:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 18:46:34 [DEBUG   ] Finished updating board flags in 0.947 seconds
2012-08-08 18:46:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:47:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:47:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:47:33 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa27, chip 2
2012-08-08 18:47:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 18:47:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 18:47:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 18:47:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:47:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 18:47:34 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 18:47:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 18:47:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 18:47:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:47:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 18:47:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:47:34 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-08 18:47:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 18:47:35 [DEBUG   ] Finished updating board flags in 1.218 seconds
2012-08-08 18:47:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:48:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:48:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:48:33 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa27, chip 2
2012-08-08 18:48:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 18:48:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 18:48:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 18:48:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 18:48:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:48:34 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 18:48:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 18:48:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 18:48:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 18:48:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-08 18:48:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 18:48:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 18:48:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:48:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 18:48:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 18:48:34 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 18:48:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-08 18:48:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 18:48:34 [DEBUG   ] Finished updating board flags in 1.040 seconds
2012-08-08 18:48:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:49:06 [DEBUG   ] Got command RPT from MCS: ref #6859
2012-08-08 18:49:06 [DEBUG   ] summary = WARNING
2012-08-08 18:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6859  15 56147 67746236 AWARNINGWARNING'
2012-08-08 18:49:06 [DEBUG   ] Got command RPT from MCS: ref #6860
2012-08-08 18:49:06 [DEBUG   ] info = BOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards
2012-08-08 18:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6860 110 56147 67746237 AWARNINGBOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards'
2012-08-08 18:49:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:49:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:49:33 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-08 18:49:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 18:49:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 18:49:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:49:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 18:49:34 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 18:49:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 18:49:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 18:49:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2012-08-08 18:49:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 18:49:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:49:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 18:49:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:49:34 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-08 18:49:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 18:49:34 [DEBUG   ] Finished updating board flags in 1.010 seconds
2012-08-08 18:49:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:50:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:50:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:50:33 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-08 18:50:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 18:50:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-08 18:50:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 18:50:34 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 18:50:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 18:50:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 18:50:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 18:50:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 18:50:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 18:50:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2012-08-08 18:50:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:50:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 18:50:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 18:50:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 18:50:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:50:34 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 18:50:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 4
2012-08-08 18:50:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2012-08-08 18:50:34 [DEBUG   ] Finished updating board flags in 0.994 seconds
2012-08-08 18:50:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:51:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:51:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:51:34 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 18:51:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 18:51:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 18:51:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 18:51:34 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 18:51:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 18:51:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:51:34 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 18:51:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 18:51:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2012-08-08 18:51:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 18:51:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:51:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 18:51:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 18:51:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 18:51:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:51:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 18:51:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-08 18:51:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 18:51:34 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-08 18:51:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 18:51:35 [DEBUG   ] Finished updating board flags in 0.929 seconds
2012-08-08 18:51:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:52:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:52:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:52:34 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 18:52:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 18:52:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 18:52:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 18:52:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:52:34 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-08 18:52:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 18:52:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 18:52:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:52:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 18:52:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 18:52:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:52:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 18:52:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 18:52:35 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 18:52:35 [DEBUG   ] Finished updating board flags in 0.934 seconds
2012-08-08 18:52:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:53:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:53:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:53:34 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 18:53:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 18:53:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2012-08-08 18:53:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 18:53:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:53:34 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-08 18:53:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 18:53:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 18:53:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 18:53:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 18:53:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:53:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 18:53:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:53:35 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 18:53:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 18:53:35 [DEBUG   ] Finished updating board flags in 1.118 seconds
2012-08-08 18:53:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:54:06 [DEBUG   ] Got command RPT from MCS: ref #6876
2012-08-08 18:54:06 [DEBUG   ] summary = WARNING
2012-08-08 18:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6876  15 56147 68046233 AWARNINGWARNING'
2012-08-08 18:54:06 [DEBUG   ] Got command RPT from MCS: ref #6877
2012-08-08 18:54:06 [DEBUG   ] info = BOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards
2012-08-08 18:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6877 110 56147 68046233 AWARNINGBOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards'
2012-08-08 18:54:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:54:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:54:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 18:54:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 18:54:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 18:54:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 18:54:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:54:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 18:54:34 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-08 18:54:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 18:54:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 18:54:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2012-08-08 18:54:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:54:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 18:54:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:54:35 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 18:54:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 18:54:35 [DEBUG   ] Finished updating board flags in 0.839 seconds
2012-08-08 18:54:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:55:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:55:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:55:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 18:55:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 18:55:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:55:34 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-08 18:55:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 18:55:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 18:55:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 18:55:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 18:55:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2012-08-08 18:55:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 18:55:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-08 18:55:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 18:55:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:55:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 18:55:35 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 18:55:35 [DEBUG   ] Finished updating board flags in 0.846 seconds
2012-08-08 18:55:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:56:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:56:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:56:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 18:56:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 18:56:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 18:56:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 18:56:34 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-08 18:56:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 18:56:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 18:56:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 18:56:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-08 18:56:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:56:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 18:56:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 18:56:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:56:35 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 18:56:35 [DEBUG   ] Finished updating board flags in 0.859 seconds
2012-08-08 18:56:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:57:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:57:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:57:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 18:57:34 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-08 18:57:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-08 18:57:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 18:57:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 18:57:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 18:57:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 18:57:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 18:57:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:57:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 18:57:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:57:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 18:57:35 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 18:57:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 18:57:35 [DEBUG   ] Finished updating board flags in 0.850 seconds
2012-08-08 18:57:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:58:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:58:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:58:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 18:58:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 18:58:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 18:58:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 18:58:34 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 18:58:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 18:58:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 18:58:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 18:58:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:58:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 18:58:35 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 18:58:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 18:58:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2012-08-08 18:58:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 18:58:35 [DEBUG   ] Finished updating board flags in 0.965 seconds
2012-08-08 18:58:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:59:06 [DEBUG   ] Got command RPT from MCS: ref #6893
2012-08-08 18:59:06 [DEBUG   ] summary = NORMAL
2012-08-08 18:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6893  14 56147 68346233 A NORMALNORMAL'
2012-08-08 18:59:06 [DEBUG   ] Got command RPT from MCS: ref #6894
2012-08-08 18:59:06 [DEBUG   ] info = Warning condition cleared, system operating normally
2012-08-08 18:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6894  60 56147 68346233 A NORMALWarning condition cleared, system operating normally'
2012-08-08 18:59:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:59:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 18:59:34 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 18:59:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 18:59:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 18:59:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 18:59:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 18:59:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 18:59:35 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 18:59:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 18:59:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 18:59:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 18:59:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 18:59:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 18:59:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 18:59:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 18:59:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 18:59:35 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 18:59:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 18:59:35 [DEBUG   ] Finished updating board flags in 1.161 seconds
2012-08-08 18:59:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 19:00:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 19:00:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 19:00:35 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:00:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:00:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 19:00:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:00:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:00:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 19:00:35 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:00:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2012-08-08 19:00:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:00:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 19:00:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:00:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:00:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:00:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 19:00:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 19:00:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 19:00:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 1
2012-08-08 19:00:35 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 19:00:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 19:00:35 [DEBUG   ] Finished updating board flags in 0.918 seconds
2012-08-08 19:00:52 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 19:01:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 19:01:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 19:01:35 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-08 19:01:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 19:01:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:01:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:01:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:01:35 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:01:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 19:01:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 19:01:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:01:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 19:01:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:01:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:01:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 19:01:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 19:01:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 1
2012-08-08 19:01:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 19:01:35 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 19:01:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 19:01:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:01:36 [DEBUG   ] Finished updating board flags in 0.908 seconds
2012-08-08 19:01:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 19:02:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 19:02:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 19:02:35 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-08 19:02:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 19:02:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 19:02:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:02:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 19:02:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 19:02:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:02:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:02:35 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:02:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 19:02:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:02:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-08 19:02:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2012-08-08 19:02:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:02:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:02:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:02:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-08 19:02:36 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:02:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:02:36 [DEBUG   ] Finished updating board flags in 0.907 seconds
2012-08-08 19:02:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 19:03:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 19:03:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 19:03:35 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-08 19:03:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 19:03:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 19:03:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-08 19:03:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 19:03:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:03:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 4
2012-08-08 19:03:35 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:03:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2012-08-08 19:03:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 19:03:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 19:03:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:03:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:03:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 19:03:36 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 19:03:36 [DEBUG   ] Finished updating board flags in 1.105 seconds
2012-08-08 19:03:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 19:04:06 [DEBUG   ] Got command RPT from MCS: ref #6910
2012-08-08 19:04:06 [DEBUG   ] summary = WARNING
2012-08-08 19:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6910  15 56147 68646229 AWARNINGWARNING'
2012-08-08 19:04:06 [DEBUG   ] Got command RPT from MCS: ref #6911
2012-08-08 19:04:06 [DEBUG   ] info = BOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards
2012-08-08 19:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6911 110 56147 68646229 AWARNINGBOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards'
2012-08-08 19:04:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 19:04:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 19:04:35 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:04:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:04:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 19:04:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:04:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:04:35 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:04:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 19:04:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 19:04:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 19:04:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 19:04:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-08 19:04:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:04:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:04:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:04:36 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 19:04:36 [DEBUG   ] Finished updating board flags in 0.899 seconds
2012-08-08 19:04:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 19:05:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 19:05:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-08 19:05:35 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:05:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 19:05:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 19:05:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 19:05:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-08 19:05:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 19:05:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 19:05:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:05:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:05:35 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 19:05:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:05:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 19:05:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 19:05:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 19:05:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:05:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:05:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 19:05:36 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:05:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 19:05:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:05:36 [DEBUG   ] Finished updating board flags in 0.839 seconds
2012-08-08 19:05:52 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-08 19:06:12 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-08 19:06:32 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-08 19:06:35 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:06:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:06:35 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 19:06:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 19:06:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 19:06:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 2
2012-08-08 19:06:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-08 19:06:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:06:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:06:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:06:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 19:06:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 19:06:36 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:06:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-08 19:06:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 19:06:36 [DEBUG   ] Finished updating board flags in 0.850 seconds
2012-08-08 19:06:52 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-08 19:07:12 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-08 19:07:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-08 19:07:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:07:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:07:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:07:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 19:07:35 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 19:07:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 19:07:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 19:07:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:07:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:07:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:07:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 19:07:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 19:07:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 19:07:36 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 19:07:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 19:07:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 19:07:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:07:36 [DEBUG   ] Finished updating board flags in 0.849 seconds
2012-08-08 19:07:52 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-08 19:08:12 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2012-08-08 19:08:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 19:08:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 19:08:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:08:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:08:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:08:35 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 19:08:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 19:08:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:08:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-08 19:08:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2012-08-08 19:08:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:08:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:08:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:08:36 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:08:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-08 19:08:36 [DEBUG   ] Finished updating board flags in 0.849 seconds
2012-08-08 19:08:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 19:09:06 [DEBUG   ] Got command RPT from MCS: ref #6927
2012-08-08 19:09:06 [DEBUG   ] summary = NORMAL
2012-08-08 19:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6927  14 56147 68946237 A NORMALNORMAL'
2012-08-08 19:09:06 [DEBUG   ] Got command RPT from MCS: ref #6928
2012-08-08 19:09:06 [DEBUG   ] info = Warning condition cleared, system operating normally
2012-08-08 19:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6928  60 56147 68946237 A NORMALWarning condition cleared, system operating normally'
2012-08-08 19:09:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 19:09:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 19:09:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:09:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 19:09:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:09:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:09:35 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 19:09:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 19:09:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa34, chip 1
2012-08-08 19:09:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:09:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:09:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 19:09:36 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:09:36 [DEBUG   ] Finished updating board flags in 0.922 seconds
2012-08-08 19:09:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 19:10:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 19:10:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 19:10:35 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:10:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:10:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 19:10:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-08 19:10:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 19:10:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:10:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:10:36 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 19:10:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 19:10:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-08 19:10:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:10:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:10:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:10:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-08 19:10:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:10:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 19:10:36 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:10:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 4
2012-08-08 19:10:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:10:36 [DEBUG   ] Finished updating board flags in 0.923 seconds
2012-08-08 19:10:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 19:11:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 19:11:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 19:11:35 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:11:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 19:11:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:11:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 19:11:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:11:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:11:36 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:11:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 19:11:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-08 19:11:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:11:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:11:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 19:11:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:11:36 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:11:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2012-08-08 19:11:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:11:36 [DEBUG   ] Finished updating board flags in 1.054 seconds
2012-08-08 19:11:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 19:12:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 19:12:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 19:12:36 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-08 19:12:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:12:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 19:12:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:12:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:12:36 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:12:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 19:12:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 19:12:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:12:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:12:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 19:12:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:12:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 19:12:36 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 19:12:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-08 19:12:36 [DEBUG   ] Finished updating board flags in 0.920 seconds
2012-08-08 19:12:53 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-08 19:13:13 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-08 19:13:33 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-08 19:13:36 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-08 19:13:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 19:13:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:13:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 19:13:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:13:36 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:13:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 19:13:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 19:13:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 19:13:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:13:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-08 19:13:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:13:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:13:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 19:13:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:13:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 19:13:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-08 19:13:36 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 19:13:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 2
2012-08-08 19:13:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 19:13:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:13:36 [DEBUG   ] Finished updating board flags in 0.850 seconds
2012-08-08 19:13:53 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-08 19:14:06 [DEBUG   ] Got command RPT from MCS: ref #6944
2012-08-08 19:14:06 [DEBUG   ] summary = WARNING
2012-08-08 19:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6944  15 56147 69246244 AWARNINGWARNING'
2012-08-08 19:14:06 [DEBUG   ] Got command RPT from MCS: ref #6945
2012-08-08 19:14:06 [DEBUG   ] info = BOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards
2012-08-08 19:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6945 110 56147 69246245 AWARNINGBOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards'
2012-08-08 19:14:13 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-08 19:14:33 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 19:14:36 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-08 19:14:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 19:14:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 19:14:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:14:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 19:14:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 19:14:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:14:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:14:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 19:14:36 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:14:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 1
2012-08-08 19:14:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 19:14:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 19:14:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:14:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-08 19:14:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 19:14:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2012-08-08 19:14:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:14:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:14:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:14:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 19:14:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 19:14:36 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:14:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:14:36 [DEBUG   ] Finished updating board flags in 0.850 seconds
2012-08-08 19:14:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 19:15:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 19:15:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-08 19:15:36 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:15:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 19:15:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:15:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 19:15:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 19:15:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:15:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:15:36 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:15:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:15:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 19:15:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:15:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:15:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 19:15:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:15:36 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:15:37 [DEBUG   ] Finished updating board flags in 0.848 seconds
2012-08-08 19:15:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 19:16:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 19:16:34 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2012-08-08 19:16:36 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:16:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 19:16:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 19:16:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:16:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:16:36 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 19:16:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:16:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:16:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:16:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 19:16:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:16:37 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:16:37 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 19:16:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:16:37 [DEBUG   ] Finished updating board flags in 0.848 seconds
2012-08-08 19:16:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 19:17:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 19:17:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 19:17:36 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:17:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:17:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:17:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:17:36 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 19:17:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 19:17:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 19:17:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 19:17:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 19:17:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2012-08-08 19:17:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:17:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:17:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:17:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 19:17:37 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 19:17:37 [DEBUG   ] Finished updating board flags in 1.045 seconds
2012-08-08 19:17:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 19:18:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 19:18:34 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-08 19:18:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:18:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 3
2012-08-08 19:18:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 19:18:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:18:36 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 19:18:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 19:18:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 19:18:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 19:18:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-08 19:18:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2012-08-08 19:18:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:18:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:18:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:18:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 19:18:37 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 19:18:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 19:18:37 [DEBUG   ] Finished updating board flags in 1.012 seconds
2012-08-08 19:18:54 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 19:19:06 [DEBUG   ] Got command RPT from MCS: ref #6961
2012-08-08 19:19:06 [DEBUG   ] summary = NORMAL
2012-08-08 19:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6961  14 56147 69546237 A NORMALNORMAL'
2012-08-08 19:19:06 [DEBUG   ] Got command RPT from MCS: ref #6962
2012-08-08 19:19:06 [DEBUG   ] info = Warning condition cleared, system operating normally
2012-08-08 19:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6962  60 56147 69546237 A NORMALWarning condition cleared, system operating normally'
2012-08-08 19:19:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 19:19:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 19:19:36 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:19:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:19:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 19:19:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:19:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:19:36 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 19:19:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 1
2012-08-08 19:19:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:19:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 19:19:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 19:19:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:19:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:19:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 19:19:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:19:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 19:19:37 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:19:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 19:19:37 [DEBUG   ] Finished updating board flags in 0.964 seconds
2012-08-08 19:19:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 19:20:15 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 19:20:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 19:20:36 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:20:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 19:20:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:20:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 19:20:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:20:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:20:36 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 19:20:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 19:20:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:20:37 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 19:20:37 [DEBUG   ] Finished updating board flags in 0.831 seconds
2012-08-08 19:20:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 19:21:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 19:21:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 19:21:36 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-08 19:21:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 19:21:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 19:21:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:21:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:21:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:21:36 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:21:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 19:21:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-08 19:21:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 19:21:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 19:21:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:21:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:21:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:21:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:21:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 19:21:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 19:21:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 19:21:37 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:21:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 19:21:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 19:21:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:21:37 [DEBUG   ] Finished updating board flags in 0.832 seconds
2012-08-08 19:21:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 19:22:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 19:22:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 19:22:36 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-08 19:22:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 19:22:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 19:22:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:22:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:22:36 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:22:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 19:22:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 19:22:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 19:22:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2012-08-08 19:22:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:22:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 19:22:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-08 19:22:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:22:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 19:22:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 19:22:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 19:22:37 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:22:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:22:37 [DEBUG   ] Finished updating board flags in 0.832 seconds
2012-08-08 19:22:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 19:23:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 19:23:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 19:23:36 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-08 19:23:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 19:23:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:23:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2012-08-08 19:23:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:23:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:23:36 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:23:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 19:23:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 19:23:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 19:23:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:23:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 19:23:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-08 19:23:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 19:23:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:23:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:23:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:23:37 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 19:23:37 [DEBUG   ] Finished updating board flags in 0.889 seconds
2012-08-08 19:23:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 19:24:06 [DEBUG   ] Got command RPT from MCS: ref #6978
2012-08-08 19:24:06 [DEBUG   ] summary = WARNING
2012-08-08 19:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6978  15 56147 69846237 AWARNINGWARNING'
2012-08-08 19:24:06 [DEBUG   ] Got command RPT from MCS: ref #6979
2012-08-08 19:24:06 [DEBUG   ] info = BOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards
2012-08-08 19:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6979 110 56147 69846237 AWARNINGBOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards'
2012-08-08 19:24:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 19:24:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 19:24:36 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-08 19:24:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 19:24:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:24:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 19:24:36 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:24:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-08 19:24:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 19:24:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2012-08-08 19:24:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:24:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 19:24:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 19:24:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:24:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:24:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:24:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 19:24:37 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:24:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 19:24:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:24:37 [DEBUG   ] Finished updating board flags in 0.931 seconds
2012-08-08 19:24:55 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 19:25:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 19:25:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 19:25:36 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-08 19:25:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 19:25:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 19:25:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:25:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 19:25:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 19:25:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 19:25:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:25:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:25:37 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:25:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 19:25:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:25:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 19:25:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2012-08-08 19:25:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 19:25:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:25:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 19:25:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-08 19:25:37 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 19:25:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 19:25:37 [DEBUG   ] Finished updating board flags in 1.128 seconds
2012-08-08 19:25:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 19:26:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 19:26:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 19:26:37 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:26:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:26:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 19:26:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-08 19:26:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:26:37 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:26:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:26:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2012-08-08 19:26:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2012-08-08 19:26:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-08 19:26:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:26:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:26:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:26:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:26:37 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 19:26:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 19:26:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:26:37 [DEBUG   ] Finished updating board flags in 1.046 seconds
2012-08-08 19:26:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 19:27:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 19:27:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 19:27:37 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:27:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 19:27:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2012-08-08 19:27:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:27:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:27:37 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 19:27:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 19:27:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 19:27:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 19:27:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2012-08-08 19:27:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2012-08-08 19:27:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-08 19:27:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:27:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:27:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:27:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 19:27:37 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:27:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 19:27:37 [DEBUG   ] Finished updating board flags in 0.922 seconds
2012-08-08 19:27:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 19:28:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 19:28:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 19:28:37 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:28:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 19:28:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:28:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 19:28:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 19:28:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:28:37 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 19:28:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:28:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:28:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:28:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:28:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 19:28:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 19:28:37 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:28:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 4
2012-08-08 19:28:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:28:38 [DEBUG   ] Finished updating board flags in 0.908 seconds
2012-08-08 19:28:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 19:29:06 [DEBUG   ] Got command RPT from MCS: ref #6995
2012-08-08 19:29:06 [DEBUG   ] summary = WARNING
2012-08-08 19:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6995  15 56147 70146245 AWARNINGWARNING'
2012-08-08 19:29:06 [DEBUG   ] Got command RPT from MCS: ref #6996
2012-08-08 19:29:06 [DEBUG   ] info = BOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards
2012-08-08 19:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     6996 110 56147 70146245 AWARNINGBOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards'
2012-08-08 19:29:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 19:29:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 19:29:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2012-08-08 19:29:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 19:29:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2012-08-08 19:29:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 19:29:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:29:37 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:29:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 19:29:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 19:29:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 19:29:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:29:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2012-08-08 19:29:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:29:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:29:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:29:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 19:29:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 19:29:38 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 19:29:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:29:38 [DEBUG   ] Finished updating board flags in 0.922 seconds
2012-08-08 19:29:56 [DEBUG   ] Finished updating ant stats in 1.192 seconds
2012-08-08 19:30:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 19:30:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 19:30:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:30:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 19:30:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 19:30:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:30:37 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:30:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 19:30:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:30:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 19:30:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2012-08-08 19:30:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:30:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:30:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 19:30:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-08 19:30:38 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 19:30:38 [DEBUG   ] Finished updating board flags in 1.093 seconds
2012-08-08 19:30:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 19:31:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 19:31:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 19:31:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 19:31:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:31:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:31:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:31:37 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:31:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-08 19:31:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:31:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 19:31:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-08 19:31:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-08 19:31:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 19:31:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:31:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 19:31:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 19:31:38 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 19:31:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 19:31:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:31:38 [DEBUG   ] Finished updating board flags in 0.891 seconds
2012-08-08 19:31:56 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2012-08-08 19:32:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 19:32:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 19:32:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:32:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:32:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:32:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 19:32:37 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 19:32:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 19:32:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 19:32:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:32:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 19:32:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:32:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:32:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:32:38 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:32:38 [DEBUG   ] Finished updating board flags in 0.830 seconds
2012-08-08 19:32:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 19:33:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 19:33:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 19:33:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:33:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:33:37 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:33:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 19:33:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:33:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 19:33:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2012-08-08 19:33:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:33:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:33:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:33:38 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:33:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 19:33:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:33:38 [DEBUG   ] Finished updating board flags in 0.853 seconds
2012-08-08 19:33:56 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2012-08-08 19:34:06 [DEBUG   ] Got command RPT from MCS: ref #7012
2012-08-08 19:34:06 [DEBUG   ] summary = NORMAL
2012-08-08 19:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7012  14 56147 70446237 A NORMALNORMAL'
2012-08-08 19:34:06 [DEBUG   ] Got command RPT from MCS: ref #7013
2012-08-08 19:34:06 [DEBUG   ] info = Warning condition cleared, system operating normally
2012-08-08 19:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7013  60 56147 70446237 A NORMALWarning condition cleared, system operating normally'
2012-08-08 19:34:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 19:34:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 19:34:37 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:34:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 19:34:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:34:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:34:37 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:34:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 19:34:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:34:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-08 19:34:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:34:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:34:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:34:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 19:34:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:34:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-08 19:34:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 19:34:38 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 19:34:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 19:34:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:34:38 [DEBUG   ] Finished updating board flags in 0.854 seconds
2012-08-08 19:34:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 19:35:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 19:35:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 19:35:37 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:35:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:35:37 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:35:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 3
2012-08-08 19:35:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:35:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:35:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:35:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:35:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 19:35:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 19:35:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-08 19:35:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:35:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 19:35:38 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 19:35:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 19:35:38 [DEBUG   ] Finished updating board flags in 0.875 seconds
2012-08-08 19:35:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 19:36:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 19:36:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 19:36:37 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:36:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 19:36:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:36:38 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 19:36:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2012-08-08 19:36:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:36:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 19:36:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2012-08-08 19:36:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:36:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:36:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:36:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 19:36:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:36:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 19:36:38 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:36:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:36:38 [DEBUG   ] Finished updating board flags in 0.943 seconds
2012-08-08 19:36:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 19:37:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 19:37:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 19:37:37 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:37:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:37:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:37:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 19:37:38 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:37:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2012-08-08 19:37:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 19:37:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2012-08-08 19:37:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 19:37:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:37:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:37:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 19:37:38 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:37:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:37:38 [DEBUG   ] Finished updating board flags in 1.133 seconds
2012-08-08 19:37:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 19:38:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 19:38:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 19:38:38 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:38:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:38:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:38:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:38:38 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 19:38:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 19:38:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 19:38:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 19:38:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2012-08-08 19:38:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 19:38:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:38:38 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:38:38 [DEBUG   ] Finished updating board flags in 0.928 seconds
2012-08-08 19:38:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 19:39:06 [DEBUG   ] Got command RPT from MCS: ref #7029
2012-08-08 19:39:06 [DEBUG   ] summary = WARNING
2012-08-08 19:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7029  15 56147 70746249 AWARNINGWARNING'
2012-08-08 19:39:06 [DEBUG   ] Got command RPT from MCS: ref #7030
2012-08-08 19:39:06 [DEBUG   ] info = BOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards
2012-08-08 19:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7030 110 56147 70746249 AWARNINGBOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards'
2012-08-08 19:39:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 19:39:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 19:39:38 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:39:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 19:39:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 19:39:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:39:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 19:39:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:39:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:39:38 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 19:39:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 19:39:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2012-08-08 19:39:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 19:39:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:39:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:39:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:39:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 19:39:38 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 19:39:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 19:39:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:39:39 [DEBUG   ] Finished updating board flags in 0.913 seconds
2012-08-08 19:39:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 19:40:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 19:40:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 19:40:38 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:40:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-08 19:40:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:40:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:40:38 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:40:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 19:40:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 19:40:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 19:40:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-08 19:40:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:40:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 19:40:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:40:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 19:40:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:40:39 [DEBUG   ] Finished updating board flags in 0.911 seconds
2012-08-08 19:40:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 19:41:16 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2012-08-08 19:41:36 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 19:41:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:41:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 19:41:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-08 19:41:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:41:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 19:41:38 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:41:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 19:41:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 19:41:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2012-08-08 19:41:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 19:41:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:41:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:41:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:41:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 19:41:39 [DEBUG   ] Finished updating board flags in 1.086 seconds
2012-08-08 19:41:56 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 19:42:16 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 19:42:36 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 19:42:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 19:42:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:42:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:42:38 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:42:38 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 19:42:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 19:42:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:42:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:42:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:42:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-08 19:42:39 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:42:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 19:42:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 19:42:39 [DEBUG   ] Finished updating board flags in 0.898 seconds
2012-08-08 19:42:56 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 19:43:16 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 19:43:36 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 19:43:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 19:43:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 19:43:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:43:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:43:38 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:43:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:43:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 19:43:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-08 19:43:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2012-08-08 19:43:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:43:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:43:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:43:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 19:43:39 [DEBUG   ] Finished updating board flags in 0.838 seconds
2012-08-08 19:43:56 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 19:44:06 [DEBUG   ] Got command RPT from MCS: ref #7046
2012-08-08 19:44:06 [DEBUG   ] summary = NORMAL
2012-08-08 19:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7046  14 56147 71046240 A NORMALNORMAL'
2012-08-08 19:44:06 [DEBUG   ] Got command RPT from MCS: ref #7047
2012-08-08 19:44:06 [DEBUG   ] info = Warning condition cleared, system operating normally
2012-08-08 19:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7047  60 56147 71046241 A NORMALWarning condition cleared, system operating normally'
2012-08-08 19:44:16 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 19:44:36 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 19:44:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 19:44:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:44:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 19:44:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 19:44:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:44:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:44:38 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 19:44:38 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 19:44:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 19:44:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 19:44:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 19:44:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:44:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 19:44:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:44:39 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 19:44:39 [DEBUG   ] Finished updating board flags in 0.912 seconds
2012-08-08 19:44:56 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 19:45:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 19:45:36 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 19:45:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:45:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:45:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:45:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 19:45:38 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:45:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 19:45:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 19:45:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 19:45:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:45:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-08 19:45:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:45:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 19:45:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 19:45:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 19:45:39 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:45:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:45:39 [DEBUG   ] Finished updating board flags in 0.915 seconds
2012-08-08 19:45:56 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 19:46:16 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 19:46:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 19:46:38 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:46:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 19:46:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 19:46:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:46:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:46:39 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:46:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 19:46:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 19:46:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:46:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-08 19:46:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 19:46:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:46:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:46:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:46:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:46:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 19:46:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 19:46:39 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:46:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 19:46:39 [DEBUG   ] Finished updating board flags in 0.972 seconds
2012-08-08 19:46:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 19:47:16 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 19:47:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 19:47:39 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:47:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 19:47:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 19:47:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:47:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:47:39 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:47:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2012-08-08 19:47:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 19:47:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 19:47:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 19:47:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 19:47:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-08 19:47:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:47:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:47:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 19:47:39 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:47:39 [DEBUG   ] Finished updating board flags in 1.062 seconds
2012-08-08 19:47:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 19:48:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 19:48:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 19:48:39 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:48:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 19:48:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:48:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 19:48:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 19:48:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-08 19:48:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:48:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 4
2012-08-08 19:48:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:48:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 19:48:39 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:48:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 19:48:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 19:48:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-08 19:48:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 19:48:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:48:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:48:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:48:39 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:48:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 19:48:39 [DEBUG   ] Finished updating board flags in 0.943 seconds
2012-08-08 19:48:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 19:49:06 [DEBUG   ] Got command RPT from MCS: ref #7065
2012-08-08 19:49:06 [DEBUG   ] summary = WARNING
2012-08-08 19:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7065  15 56147 71346240 AWARNINGWARNING'
2012-08-08 19:49:06 [DEBUG   ] Got command RPT from MCS: ref #7066
2012-08-08 19:49:06 [DEBUG   ] info = BOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards
2012-08-08 19:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7066 110 56147 71346241 AWARNINGBOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards'
2012-08-08 19:49:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 19:49:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 19:49:39 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:49:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:49:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 19:49:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-08 19:49:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:49:39 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:49:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 19:49:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2012-08-08 19:49:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:49:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:49:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:49:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 19:49:40 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:49:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 19:49:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 4
2012-08-08 19:49:40 [DEBUG   ] Finished updating board flags in 0.925 seconds
2012-08-08 19:49:56 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 19:50:16 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2012-08-08 19:50:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:50:39 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:50:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 19:50:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 19:50:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:50:39 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 19:50:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 19:50:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 19:50:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2012-08-08 19:50:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 19:50:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:50:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:50:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:50:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:50:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 19:50:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 19:50:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:50:40 [DEBUG   ] Finished updating board flags in 0.927 seconds
2012-08-08 19:50:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 19:51:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:51:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:51:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:51:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 19:51:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:51:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:51:39 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 19:51:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 19:51:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 19:51:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 19:51:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:51:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2012-08-08 19:51:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:51:40 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 19:51:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:51:40 [DEBUG   ] Finished updating board flags in 1.058 seconds
2012-08-08 19:51:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:52:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:52:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:52:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 19:52:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:52:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:52:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:52:39 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 19:52:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 19:52:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 19:52:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 19:52:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:52:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 19:52:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:52:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:52:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:52:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 19:52:40 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:52:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:52:40 [DEBUG   ] Finished updating board flags in 0.913 seconds
2012-08-08 19:52:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:53:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:53:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:53:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 19:53:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 19:53:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 19:53:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:53:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 19:53:39 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 19:53:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 19:53:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 19:53:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:53:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 19:53:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-08 19:53:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:53:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:53:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:53:40 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 19:53:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-08 19:53:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 19:53:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:53:40 [DEBUG   ] Finished updating board flags in 0.971 seconds
2012-08-08 19:53:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:54:06 [DEBUG   ] Got command RPT from MCS: ref #7082
2012-08-08 19:54:06 [DEBUG   ] summary = NORMAL
2012-08-08 19:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7082  14 56147 71646245 A NORMALNORMAL'
2012-08-08 19:54:06 [DEBUG   ] Got command RPT from MCS: ref #7083
2012-08-08 19:54:06 [DEBUG   ] info = Warning condition cleared, system operating normally
2012-08-08 19:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7083  60 56147 71646245 A NORMALWarning condition cleared, system operating normally'
2012-08-08 19:54:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:54:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:54:39 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:54:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 19:54:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2012-08-08 19:54:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:54:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 19:54:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:54:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:54:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 19:54:39 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:54:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 19:54:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 19:54:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-08 19:54:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 19:54:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:54:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:54:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-08 19:54:40 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:54:40 [DEBUG   ] Finished updating board flags in 0.911 seconds
2012-08-08 19:54:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:55:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:55:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:55:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2012-08-08 19:55:39 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:55:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 19:55:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 19:55:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:55:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 19:55:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:55:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:55:40 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:55:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:55:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 19:55:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-08 19:55:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:55:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 1
2012-08-08 19:55:40 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:55:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:55:40 [DEBUG   ] Finished updating board flags in 0.933 seconds
2012-08-08 19:55:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:56:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:56:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:56:40 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:56:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:56:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 19:56:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:56:40 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:56:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 19:56:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:56:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 19:56:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 19:56:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 19:56:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 19:56:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:56:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 19:56:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 19:56:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 1
2012-08-08 19:56:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 19:56:40 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 19:56:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 19:56:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-08 19:56:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 19:56:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:56:40 [DEBUG   ] Finished updating board flags in 1.034 seconds
2012-08-08 19:56:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:57:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:57:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:57:40 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-08 19:57:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:57:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-08 19:57:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:57:40 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 19:57:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 19:57:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:57:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:57:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 19:57:40 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:57:40 [DEBUG   ] Finished updating board flags in 0.917 seconds
2012-08-08 19:57:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:58:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:58:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:58:40 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:58:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 19:58:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 19:58:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:58:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:58:40 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 19:58:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 19:58:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:58:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa34, chip 1
2012-08-08 19:58:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 19:58:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:58:40 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 19:58:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 19:58:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 19:58:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 19:58:41 [DEBUG   ] Finished updating board flags in 0.912 seconds
2012-08-08 19:58:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:59:06 [DEBUG   ] Got command RPT from MCS: ref #7099
2012-08-08 19:59:06 [DEBUG   ] summary = WARNING
2012-08-08 19:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7099  15 56147 71946245 AWARNINGWARNING'
2012-08-08 19:59:06 [DEBUG   ] Got command RPT from MCS: ref #7100
2012-08-08 19:59:06 [DEBUG   ] info = BOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards
2012-08-08 19:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7100 110 56147 71946245 AWARNINGBOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards'
2012-08-08 19:59:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:59:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 19:59:40 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 19:59:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 19:59:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 19:59:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 5
2012-08-08 19:59:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 19:59:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 19:59:40 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 19:59:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 19:59:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2012-08-08 19:59:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 19:59:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 19:59:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2012-08-08 19:59:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 19:59:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 19:59:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 19:59:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 19:59:41 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 19:59:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 19:59:41 [DEBUG   ] Finished updating board flags in 0.921 seconds
2012-08-08 19:59:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 20:00:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 20:00:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 20:00:40 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 20:00:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 20:00:40 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 20:00:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 20:00:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 20:00:40 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 20:00:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 20:00:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 20:00:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 20:00:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 20:00:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 20:00:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 20:00:41 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 20:00:41 [DEBUG   ] Finished updating board flags in 1.092 seconds
2012-08-08 20:00:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 20:01:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 20:01:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 20:01:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 20:01:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 20:01:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 20:01:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 20:01:40 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 20:01:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 20:01:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 20:01:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 20:01:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 20:01:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 20:01:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 20:01:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 20:01:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 20:01:41 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 20:01:41 [DEBUG   ] Finished updating board flags in 0.924 seconds
2012-08-08 20:01:57 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2012-08-08 20:02:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 20:02:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 20:02:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 20:02:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 20:02:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 20:02:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 20:02:40 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 20:02:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 20:02:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 20:02:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 20:02:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 20:02:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 20:02:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 20:02:41 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 20:02:41 [DEBUG   ] Finished updating board flags in 0.872 seconds
2012-08-08 20:02:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 20:03:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 20:03:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 20:03:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 20:03:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 20:03:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 20:03:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 20:03:40 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 20:03:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 20:03:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 20:03:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 20:03:41 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 20:03:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 20:03:41 [DEBUG   ] Finished updating board flags in 0.905 seconds
2012-08-08 20:03:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 20:04:06 [DEBUG   ] Got command RPT from MCS: ref #7116
2012-08-08 20:04:06 [DEBUG   ] summary = NORMAL
2012-08-08 20:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7116  14 56147 72246253 A NORMALNORMAL'
2012-08-08 20:04:06 [DEBUG   ] Got command RPT from MCS: ref #7117
2012-08-08 20:04:06 [DEBUG   ] info = Warning condition cleared, system operating normally
2012-08-08 20:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7117  60 56147 72246253 A NORMALWarning condition cleared, system operating normally'
2012-08-08 20:04:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 20:04:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 20:04:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 20:04:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 20:04:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 20:04:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 20:04:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 20:04:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 20:04:41 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 20:04:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 20:04:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 20:04:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 20:04:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-08 20:04:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 20:04:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 20:04:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 20:04:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 20:04:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 20:04:41 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 20:04:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 20:04:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 20:04:41 [DEBUG   ] Finished updating board flags in 0.907 seconds
2012-08-08 20:04:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 20:05:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 20:05:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 20:05:40 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 20:05:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 20:05:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 20:05:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 20:05:41 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 20:05:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 20:05:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 20:05:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 20:05:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 20:05:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 20:05:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-08 20:05:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 20:05:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 20:05:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 20:05:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 20:05:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 20:05:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-08 20:05:41 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 20:05:41 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 20:05:41 [DEBUG   ] Finished updating board flags in 0.907 seconds
2012-08-08 20:05:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 20:06:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 20:06:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 20:06:41 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 20:06:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 20:06:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 20:06:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 20:06:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 20:06:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 20:06:41 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 20:06:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 20:06:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 20:06:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 20:06:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 20:06:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 20:06:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 20:06:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 20:06:41 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 20:06:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 20:06:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2012-08-08 20:06:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 20:06:41 [DEBUG   ] Finished updating board flags in 1.056 seconds
2012-08-08 20:06:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 20:07:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 20:07:32 [DEBUG   ] Got command INI from MCS: ref #7133
2012-08-08 20:07:32 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2012-08-08 20:07:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI     7133   8 56147 72452077 ABOOTING'
2012-08-08 20:07:48 [INFO    ] -------------------
2012-08-08 20:07:48 [INFO    ]  LWA board status
2012-08-08 20:07:48 [INFO    ] -------------------
2012-08-08 20:07:48 [INFO    ] DP 1: 2 lwa27
2012-08-08 20:07:48 [INFO    ] DP 1: 3 lwa24
2012-08-08 20:07:48 [INFO    ] DP 1: 4 lwa23
2012-08-08 20:07:48 [INFO    ] DP 1: 5 lwa18
2012-08-08 20:07:48 [INFO    ] DP 1: 6 lwa10
2012-08-08 20:07:48 [INFO    ] DP 1: 7 lwa32
2012-08-08 20:07:48 [INFO    ] DP 1: 8 lwa11
2012-08-08 20:07:48 [INFO    ] DP 1: 9 lwa30
2012-08-08 20:07:48 [INFO    ] DP 1: 10 lwa12
2012-08-08 20:07:48 [INFO    ] DP 1: 11 lwa8
2012-08-08 20:07:48 [INFO    ] DP 1: 12 lwa13
2012-08-08 20:07:48 [INFO    ] DP 1: 13 lwa26
2012-08-08 20:07:48 [INFO    ] DP 1: 14 lwa14
2012-08-08 20:07:48 [INFO    ] DP 1: 16 lwa22
2012-08-08 20:07:48 [INFO    ] DP 1: 17 lwa20
2012-08-08 20:07:48 [INFO    ] DP 1: 18 lwa1
2012-08-08 20:07:48 [INFO    ] DP 1: 19 lwa5
2012-08-08 20:07:48 [INFO    ] DP 1: 20 lwa25
2012-08-08 20:07:48 [INFO    ] DP 1: 21 lwa35
2012-08-08 20:07:48 [INFO    ] DP 1: 22 lwa19
2012-08-08 20:07:48 [INFO    ] DP 1: 23 lwa21
2012-08-08 20:07:48 [INFO    ] DP 1: 24 lwa6
2012-08-08 20:07:48 [INFO    ] DP 1: 25 lwa7
2012-08-08 20:07:48 [INFO    ] DP 1: 26 lwa33
2012-08-08 20:07:48 [INFO    ] DP 1: 27 lwa15
2012-08-08 20:07:48 [INFO    ] DP 1: 28 lwa28
2012-08-08 20:07:48 [INFO    ] DP 2: 1 lwa16
2012-08-08 20:07:48 [INFO    ] DP 2: 15 lwa34
2012-08-08 20:07:48 [INFO    ] Total of 28 boards
2012-08-08 20:07:48 [INFO    ] Total of 260 stands
2012-08-08 20:07:48 [INFO    ] -------------------
2012-08-08 20:07:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27365
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27366
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27367
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27368
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27369
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27370
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27371
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27372
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27373
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27374
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27375
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27376
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27377
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27378
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27379
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27380
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27381
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27382
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27383
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27384
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27385
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27386
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27387
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27388
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27389
2012-08-08 20:07:55 [DEBUG   ] 2012-08-08 20:07:55 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27390
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27365 exited with status 0
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27366 exited with status 0
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27367 exited with status 0
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27368 exited with status 0
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27369 exited with status 0
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27370 exited with status 0
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27371 exited with status 0
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27372 exited with status 0
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27373 exited with status 0
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27374 exited with status 0
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27375 exited with status 0
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27376 exited with status 0
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27377 exited with status 0
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27378 exited with status 0
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27379 exited with status 0
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27380 exited with status 0
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27381 exited with status 0
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27382 exited with status 0
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27383 exited with status 0
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27384 exited with status 0
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27385 exited with status 0
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27386 exited with status 0
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27387 exited with status 0
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27388 exited with status 0
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27389 exited with status 0
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27390 exited with status 0
2012-08-08 20:08:07 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] spawn_process: at 2012-08-08 20:08:07 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 27417
2012-08-08 20:08:07 [DEBUG   ] 2012-08-08 20:08:07 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 27418
2012-08-08 20:08:13 [DEBUG   ] 2012-08-08 20:08:13 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 27417 exited with status 0
2012-08-08 20:08:13 [DEBUG   ] 2012-08-08 20:08:13 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 27418 exited with status 0
2012-08-08 20:08:13 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2012-08-08 20:08:13 [DEBUG   ] spawn_process: at 2012-08-08 20:08:13 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2012-08-08 20:08:13 [DEBUG   ] spawn_process: at 2012-08-08 20:08:13 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2012-08-08 20:08:13 [INFO    ] Setting Beam 1 xbars
2012-08-08 20:08:13 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2012-08-08 20:08:13 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2012-08-08 20:08:13 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2012-08-08 20:08:13 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2012-08-08 20:08:13 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2012-08-08 20:08:14 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2012-08-08 20:08:14 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2012-08-08 20:08:14 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2012-08-08 20:08:14 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2012-08-08 20:08:14 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2012-08-08 20:08:14 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2012-08-08 20:08:14 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2012-08-08 20:08:14 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2012-08-08 20:08:14 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2012-08-08 20:08:15 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2012-08-08 20:08:15 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2012-08-08 20:08:15 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2012-08-08 20:08:15 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2012-08-08 20:08:15 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2012-08-08 20:08:15 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2012-08-08 20:08:15 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2012-08-08 20:08:15 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2012-08-08 20:08:15 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2012-08-08 20:08:16 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2012-08-08 20:08:16 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2012-08-08 20:08:16 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2012-08-08 20:08:16 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2012-08-08 20:08:16 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2012-08-08 20:08:16 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2012-08-08 20:08:16 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2012-08-08 20:08:16 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2012-08-08 20:08:16 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2012-08-08 20:08:17 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2012-08-08 20:08:17 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2012-08-08 20:08:17 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2012-08-08 20:08:17 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2012-08-08 20:08:17 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2012-08-08 20:08:17 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2012-08-08 20:08:17 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2012-08-08 20:08:17 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2012-08-08 20:08:17 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2012-08-08 20:08:17 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2012-08-08 20:08:18 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2012-08-08 20:08:18 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2012-08-08 20:08:18 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2012-08-08 20:08:18 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2012-08-08 20:08:18 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2012-08-08 20:08:18 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2012-08-08 20:08:18 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2012-08-08 20:08:18 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2012-08-08 20:08:18 [INFO    ] Setting Beam 2 xbars
2012-08-08 20:08:18 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2012-08-08 20:08:19 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2012-08-08 20:08:19 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2012-08-08 20:08:19 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2012-08-08 20:08:19 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2012-08-08 20:08:19 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2012-08-08 20:08:19 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2012-08-08 20:08:19 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2012-08-08 20:08:19 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2012-08-08 20:08:19 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2012-08-08 20:08:20 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2012-08-08 20:08:20 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2012-08-08 20:08:20 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2012-08-08 20:08:20 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2012-08-08 20:08:20 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2012-08-08 20:08:20 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2012-08-08 20:08:20 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2012-08-08 20:08:20 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2012-08-08 20:08:20 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2012-08-08 20:08:21 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2012-08-08 20:08:21 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2012-08-08 20:08:21 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2012-08-08 20:08:21 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2012-08-08 20:08:21 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2012-08-08 20:08:21 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2012-08-08 20:08:21 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2012-08-08 20:08:21 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2012-08-08 20:08:21 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2012-08-08 20:08:22 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2012-08-08 20:08:22 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2012-08-08 20:08:22 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2012-08-08 20:08:22 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2012-08-08 20:08:22 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2012-08-08 20:08:22 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2012-08-08 20:08:22 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2012-08-08 20:08:22 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2012-08-08 20:08:22 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2012-08-08 20:08:23 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2012-08-08 20:08:23 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2012-08-08 20:08:23 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2012-08-08 20:08:23 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2012-08-08 20:08:23 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2012-08-08 20:08:23 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2012-08-08 20:08:23 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2012-08-08 20:08:23 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2012-08-08 20:08:23 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2012-08-08 20:08:23 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2012-08-08 20:08:24 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2012-08-08 20:08:24 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2012-08-08 20:08:24 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2012-08-08 20:08:24 [INFO    ] Setting Beam 3 xbars
2012-08-08 20:08:24 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2012-08-08 20:08:24 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2012-08-08 20:08:24 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2012-08-08 20:08:24 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2012-08-08 20:08:24 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2012-08-08 20:08:24 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2012-08-08 20:08:25 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2012-08-08 20:08:25 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2012-08-08 20:08:25 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2012-08-08 20:08:25 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2012-08-08 20:08:25 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2012-08-08 20:08:25 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2012-08-08 20:08:25 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2012-08-08 20:08:25 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2012-08-08 20:08:25 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2012-08-08 20:08:26 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2012-08-08 20:08:26 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2012-08-08 20:08:26 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2012-08-08 20:08:26 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2012-08-08 20:08:26 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2012-08-08 20:08:26 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2012-08-08 20:08:26 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2012-08-08 20:08:26 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2012-08-08 20:08:26 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2012-08-08 20:08:27 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2012-08-08 20:08:27 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2012-08-08 20:08:27 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2012-08-08 20:08:27 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2012-08-08 20:08:27 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2012-08-08 20:08:27 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2012-08-08 20:08:27 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2012-08-08 20:08:27 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2012-08-08 20:08:27 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2012-08-08 20:08:28 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2012-08-08 20:08:28 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2012-08-08 20:08:28 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2012-08-08 20:08:28 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2012-08-08 20:08:28 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2012-08-08 20:08:28 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2012-08-08 20:08:28 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2012-08-08 20:08:28 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2012-08-08 20:08:28 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2012-08-08 20:08:28 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2012-08-08 20:08:29 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2012-08-08 20:08:29 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2012-08-08 20:08:29 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2012-08-08 20:08:29 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2012-08-08 20:08:29 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2012-08-08 20:08:29 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2012-08-08 20:08:29 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2012-08-08 20:08:29 [INFO    ] Setting Beam 4 xbars
2012-08-08 20:08:29 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2012-08-08 20:08:29 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 20:08:30 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 20:08:30 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 20:08:30 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 20:08:30 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2012-08-08 20:08:30 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2012-08-08 20:08:30 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2012-08-08 20:08:30 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2012-08-08 20:08:30 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2012-08-08 20:08:30 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2012-08-08 20:08:31 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2012-08-08 20:08:31 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2012-08-08 20:08:31 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2012-08-08 20:08:31 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2012-08-08 20:08:31 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2012-08-08 20:08:31 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2012-08-08 20:08:31 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2012-08-08 20:08:31 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2012-08-08 20:08:31 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2012-08-08 20:08:32 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2012-08-08 20:08:32 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2012-08-08 20:08:32 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2012-08-08 20:08:32 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2012-08-08 20:08:32 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2012-08-08 20:08:32 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2012-08-08 20:08:32 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2012-08-08 20:08:32 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2012-08-08 20:08:32 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2012-08-08 20:08:33 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2012-08-08 20:08:33 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2012-08-08 20:08:33 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2012-08-08 20:08:33 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2012-08-08 20:08:33 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2012-08-08 20:08:33 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2012-08-08 20:08:33 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2012-08-08 20:08:33 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2012-08-08 20:08:33 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2012-08-08 20:08:33 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2012-08-08 20:08:34 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2012-08-08 20:08:34 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2012-08-08 20:08:34 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2012-08-08 20:08:34 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2012-08-08 20:08:34 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2012-08-08 20:08:34 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2012-08-08 20:08:34 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2012-08-08 20:08:34 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2012-08-08 20:08:34 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2012-08-08 20:08:35 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2012-08-08 20:08:35 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2012-08-08 20:08:35 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2012-08-08 20:08:35 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2012-08-08 20:08:35 [INFO    ] All xbars set
2012-08-08 20:08:35 [INFO    ] Setting adder chain routing for all beams
2012-08-08 20:08:40 [INFO    ] Setting beam ids
2012-08-08 20:08:50 [INFO    ] Starting beam delay calibration
2012-08-08 20:09:02 [INFO    ] Beam 1 latency is 5719
2012-08-08 20:09:02 [INFO    ] Beam 2 latency is 6705
2012-08-08 20:09:02 [INFO    ] Beam 3 latency is 6710
2012-08-08 20:09:02 [INFO    ] Beam 4 latency is 5717
2012-08-08 20:09:02 [INFO    ] Stop calibration
2012-08-08 20:09:06 [DEBUG   ] Got command RPT from MCS: ref #7134
2012-08-08 20:09:06 [DEBUG   ] summary = BOOTING
2012-08-08 20:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7134  15 56147 72546245 ABOOTINGBOOTING'
2012-08-08 20:09:06 [DEBUG   ] Got command RPT from MCS: ref #7135
2012-08-08 20:09:06 [DEBUG   ] info = Starting calibration
2012-08-08 20:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7135  28 56147 72546245 ABOOTINGStarting calibration'
2012-08-08 20:09:10 [ERROR   ] Beam delay calibration failed
2012-08-08 20:09:10 [CRITICAL] Calibration failed
2012-08-08 20:09:10 [DEBUG   ] spawn_process: at 2012-08-08 20:09:10 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2012-08-08 20:09:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2012-08-08 20:09:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2012-08-08 20:09:10 [DEBUG   ] spawn_process: at 2012-08-08 20:09:10 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2012-08-08 20:09:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2012-08-08 20:09:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2012-08-08 20:09:10 [DEBUG   ] spawn_process: at 2012-08-08 20:09:10 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2012-08-08 20:09:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2012-08-08 20:09:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2012-08-08 20:09:10 [DEBUG   ] spawn_process: at 2012-08-08 20:09:10 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2012-08-08 20:09:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2012-08-08 20:09:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2012-08-08 20:09:11 [DEBUG   ] Finished updating ant stats in 0.635 seconds
2012-08-08 20:09:11 [INFO    ] Started antennas statistics background thread
2012-08-08 20:09:11 [INFO    ] Started board flags background thread
2012-08-08 20:09:11 [INFO    ] Started BAM background thread
2012-08-08 20:09:11 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 with PID 29023
2012-08-08 20:09:11 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 with PID 29026
2012-08-08 20:09:11 [INFO    ] Finished the INI process in 99.772 s
2012-08-08 20:09:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 20:09:12 [DEBUG   ] Finished updating board flags in 0.815 seconds
2012-08-08 20:09:14 [DEBUG   ] Got command RPT from MCS: ref #7151
2012-08-08 20:09:14 [DEBUG   ] summary = ERROR
2012-08-08 20:09:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7151  13 56147 72554157 A  ERRORERROR'
2012-08-08 20:09:22 [DEBUG   ] Got command INI from MCS: ref #7152
2012-08-08 20:09:22 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2012-08-08 20:09:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI     7152   8 56147 72562741 ABOOTING'
2012-08-08 20:09:39 [INFO    ] -------------------
2012-08-08 20:09:39 [INFO    ]  LWA board status
2012-08-08 20:09:39 [INFO    ] -------------------
2012-08-08 20:09:39 [INFO    ] DP 1: 2 lwa27
2012-08-08 20:09:39 [INFO    ] DP 1: 3 lwa24
2012-08-08 20:09:39 [INFO    ] DP 1: 4 lwa23
2012-08-08 20:09:39 [INFO    ] DP 1: 5 lwa18
2012-08-08 20:09:39 [INFO    ] DP 1: 6 lwa10
2012-08-08 20:09:39 [INFO    ] DP 1: 7 lwa32
2012-08-08 20:09:39 [INFO    ] DP 1: 8 lwa11
2012-08-08 20:09:39 [INFO    ] DP 1: 9 lwa30
2012-08-08 20:09:39 [INFO    ] DP 1: 10 lwa12
2012-08-08 20:09:39 [INFO    ] DP 1: 11 lwa8
2012-08-08 20:09:39 [INFO    ] DP 1: 12 lwa13
2012-08-08 20:09:39 [INFO    ] DP 1: 13 lwa26
2012-08-08 20:09:39 [INFO    ] DP 1: 14 lwa14
2012-08-08 20:09:39 [INFO    ] DP 1: 16 lwa22
2012-08-08 20:09:39 [INFO    ] DP 1: 17 lwa20
2012-08-08 20:09:39 [INFO    ] DP 1: 18 lwa1
2012-08-08 20:09:39 [INFO    ] DP 1: 19 lwa5
2012-08-08 20:09:39 [INFO    ] DP 1: 20 lwa25
2012-08-08 20:09:39 [INFO    ] DP 1: 21 lwa35
2012-08-08 20:09:39 [INFO    ] DP 1: 22 lwa19
2012-08-08 20:09:39 [INFO    ] DP 1: 23 lwa21
2012-08-08 20:09:39 [INFO    ] DP 1: 24 lwa6
2012-08-08 20:09:39 [INFO    ] DP 1: 25 lwa7
2012-08-08 20:09:39 [INFO    ] DP 1: 26 lwa33
2012-08-08 20:09:39 [INFO    ] DP 1: 27 lwa15
2012-08-08 20:09:39 [INFO    ] DP 1: 28 lwa28
2012-08-08 20:09:39 [INFO    ] DP 2: 1 lwa16
2012-08-08 20:09:39 [INFO    ] DP 2: 15 lwa34
2012-08-08 20:09:39 [INFO    ] Total of 28 boards
2012-08-08 20:09:39 [INFO    ] Total of 260 stands
2012-08-08 20:09:39 [INFO    ] -------------------
2012-08-08 20:09:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29351
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29352
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29353
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29354
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29355
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29356
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29357
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29358
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29359
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29360
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29361
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29362
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29363
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29364
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29365
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29366
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29367
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29368
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29369
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29370
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29371
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29372
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29373
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29374
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29375
2012-08-08 20:09:46 [DEBUG   ] 2012-08-08 20:09:46 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 29376
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29351 exited with status 0
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29352 exited with status 0
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29353 exited with status 0
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29354 exited with status 0
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29355 exited with status 0
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29356 exited with status 0
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29357 exited with status 0
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29358 exited with status 0
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29359 exited with status 0
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29360 exited with status 0
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29361 exited with status 0
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29362 exited with status 0
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29363 exited with status 0
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29364 exited with status 0
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29365 exited with status 0
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29366 exited with status 0
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29367 exited with status 0
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29368 exited with status 0
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29369 exited with status 0
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29370 exited with status 0
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29371 exited with status 0
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29372 exited with status 0
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29373 exited with status 0
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29374 exited with status 0
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29375 exited with status 0
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 29376 exited with status 0
2012-08-08 20:09:58 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] spawn_process: at 2012-08-08 20:09:58 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 29403
2012-08-08 20:09:58 [DEBUG   ] 2012-08-08 20:09:58 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 29404
2012-08-08 20:10:04 [DEBUG   ] 2012-08-08 20:10:04 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 29403 exited with status 0
2012-08-08 20:10:04 [DEBUG   ] 2012-08-08 20:10:04 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 29404 exited with status 0
2012-08-08 20:10:04 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2012-08-08 20:10:04 [DEBUG   ] spawn_process: at 2012-08-08 20:10:04 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2012-08-08 20:10:04 [DEBUG   ] spawn_process: at 2012-08-08 20:10:04 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2012-08-08 20:10:04 [INFO    ] Setting Beam 1 xbars
2012-08-08 20:10:04 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2012-08-08 20:10:04 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2012-08-08 20:10:04 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2012-08-08 20:10:04 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2012-08-08 20:10:04 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2012-08-08 20:10:05 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2012-08-08 20:10:05 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2012-08-08 20:10:05 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2012-08-08 20:10:05 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2012-08-08 20:10:05 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2012-08-08 20:10:05 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2012-08-08 20:10:05 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2012-08-08 20:10:05 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2012-08-08 20:10:05 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2012-08-08 20:10:06 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2012-08-08 20:10:06 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2012-08-08 20:10:06 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2012-08-08 20:10:06 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2012-08-08 20:10:06 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2012-08-08 20:10:06 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2012-08-08 20:10:06 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2012-08-08 20:10:06 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2012-08-08 20:10:06 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2012-08-08 20:10:07 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2012-08-08 20:10:07 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2012-08-08 20:10:07 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2012-08-08 20:10:07 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2012-08-08 20:10:07 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2012-08-08 20:10:07 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2012-08-08 20:10:07 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2012-08-08 20:10:07 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2012-08-08 20:10:07 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2012-08-08 20:10:07 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2012-08-08 20:10:08 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2012-08-08 20:10:08 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2012-08-08 20:10:08 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2012-08-08 20:10:08 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2012-08-08 20:10:08 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2012-08-08 20:10:08 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2012-08-08 20:10:08 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2012-08-08 20:10:08 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2012-08-08 20:10:08 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2012-08-08 20:10:09 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2012-08-08 20:10:09 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2012-08-08 20:10:09 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2012-08-08 20:10:09 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2012-08-08 20:10:09 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2012-08-08 20:10:09 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2012-08-08 20:10:09 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2012-08-08 20:10:09 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2012-08-08 20:10:09 [INFO    ] Setting Beam 2 xbars
2012-08-08 20:10:09 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2012-08-08 20:10:10 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2012-08-08 20:10:10 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2012-08-08 20:10:10 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2012-08-08 20:10:10 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2012-08-08 20:10:10 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2012-08-08 20:10:10 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2012-08-08 20:10:10 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2012-08-08 20:10:10 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2012-08-08 20:10:10 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2012-08-08 20:10:11 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2012-08-08 20:10:11 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2012-08-08 20:10:11 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2012-08-08 20:10:11 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2012-08-08 20:10:11 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2012-08-08 20:10:11 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2012-08-08 20:10:11 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2012-08-08 20:10:11 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2012-08-08 20:10:11 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2012-08-08 20:10:12 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2012-08-08 20:10:12 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2012-08-08 20:10:12 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2012-08-08 20:10:12 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2012-08-08 20:10:12 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2012-08-08 20:10:12 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2012-08-08 20:10:12 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2012-08-08 20:10:12 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2012-08-08 20:10:12 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2012-08-08 20:10:13 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2012-08-08 20:10:13 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2012-08-08 20:10:13 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2012-08-08 20:10:13 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2012-08-08 20:10:13 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2012-08-08 20:10:13 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2012-08-08 20:10:13 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2012-08-08 20:10:13 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2012-08-08 20:10:13 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2012-08-08 20:10:14 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2012-08-08 20:10:14 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2012-08-08 20:10:14 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2012-08-08 20:10:14 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2012-08-08 20:10:14 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2012-08-08 20:10:14 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2012-08-08 20:10:14 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2012-08-08 20:10:14 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2012-08-08 20:10:14 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2012-08-08 20:10:14 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2012-08-08 20:10:15 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2012-08-08 20:10:15 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2012-08-08 20:10:15 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2012-08-08 20:10:15 [INFO    ] Setting Beam 3 xbars
2012-08-08 20:10:15 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2012-08-08 20:10:15 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2012-08-08 20:10:15 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2012-08-08 20:10:15 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2012-08-08 20:10:15 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2012-08-08 20:10:15 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2012-08-08 20:10:16 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2012-08-08 20:10:16 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2012-08-08 20:10:16 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2012-08-08 20:10:16 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2012-08-08 20:10:16 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2012-08-08 20:10:16 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2012-08-08 20:10:16 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2012-08-08 20:10:16 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2012-08-08 20:10:16 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2012-08-08 20:10:17 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2012-08-08 20:10:17 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2012-08-08 20:10:17 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2012-08-08 20:10:17 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2012-08-08 20:10:17 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2012-08-08 20:10:17 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2012-08-08 20:10:17 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2012-08-08 20:10:17 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2012-08-08 20:10:17 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2012-08-08 20:10:18 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2012-08-08 20:10:18 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2012-08-08 20:10:18 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2012-08-08 20:10:18 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2012-08-08 20:10:18 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2012-08-08 20:10:18 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2012-08-08 20:10:18 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2012-08-08 20:10:18 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2012-08-08 20:10:18 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2012-08-08 20:10:19 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2012-08-08 20:10:19 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2012-08-08 20:10:19 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2012-08-08 20:10:19 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2012-08-08 20:10:19 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2012-08-08 20:10:19 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2012-08-08 20:10:19 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2012-08-08 20:10:19 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2012-08-08 20:10:19 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2012-08-08 20:10:20 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2012-08-08 20:10:20 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2012-08-08 20:10:20 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2012-08-08 20:10:20 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2012-08-08 20:10:20 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2012-08-08 20:10:20 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2012-08-08 20:10:20 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2012-08-08 20:10:20 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2012-08-08 20:10:20 [INFO    ] Setting Beam 4 xbars
2012-08-08 20:10:20 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2012-08-08 20:10:21 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 20:10:21 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 20:10:21 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 20:10:21 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 20:10:21 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2012-08-08 20:10:21 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2012-08-08 20:10:21 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2012-08-08 20:10:21 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2012-08-08 20:10:21 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2012-08-08 20:10:21 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2012-08-08 20:10:22 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2012-08-08 20:10:22 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2012-08-08 20:10:22 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2012-08-08 20:10:22 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2012-08-08 20:10:22 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2012-08-08 20:10:22 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2012-08-08 20:10:22 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2012-08-08 20:10:22 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2012-08-08 20:10:22 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2012-08-08 20:10:23 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2012-08-08 20:10:23 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2012-08-08 20:10:23 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2012-08-08 20:10:23 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2012-08-08 20:10:23 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2012-08-08 20:10:23 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2012-08-08 20:10:23 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2012-08-08 20:10:23 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2012-08-08 20:10:23 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2012-08-08 20:10:24 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2012-08-08 20:10:24 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2012-08-08 20:10:24 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2012-08-08 20:10:24 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2012-08-08 20:10:24 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2012-08-08 20:10:24 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2012-08-08 20:10:24 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2012-08-08 20:10:24 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2012-08-08 20:10:24 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2012-08-08 20:10:25 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2012-08-08 20:10:25 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2012-08-08 20:10:25 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2012-08-08 20:10:25 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2012-08-08 20:10:25 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2012-08-08 20:10:25 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2012-08-08 20:10:25 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2012-08-08 20:10:25 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2012-08-08 20:10:25 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2012-08-08 20:10:26 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2012-08-08 20:10:26 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2012-08-08 20:10:26 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2012-08-08 20:10:26 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2012-08-08 20:10:26 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2012-08-08 20:10:26 [INFO    ] All xbars set
2012-08-08 20:10:26 [INFO    ] Setting adder chain routing for all beams
2012-08-08 20:10:31 [INFO    ] Setting beam ids
2012-08-08 20:10:41 [INFO    ] Starting beam delay calibration
2012-08-08 20:10:53 [INFO    ] Beam 1 latency is 6681
2012-08-08 20:10:53 [INFO    ] Beam 2 latency is 5745
2012-08-08 20:10:53 [INFO    ] Beam 3 latency is 5754
2012-08-08 20:10:53 [INFO    ] Beam 4 latency is 6678
2012-08-08 20:10:53 [INFO    ] Stop calibration
2012-08-08 20:11:00 [DEBUG   ] Got command RPT from MCS: ref #7153
2012-08-08 20:11:00 [DEBUG   ] summary = BOOTING
2012-08-08 20:11:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7153  15 56147 72660989 ABOOTINGBOOTING'
2012-08-08 20:11:01 [ERROR   ] Beam delay calibration failed
2012-08-08 20:11:01 [CRITICAL] Calibration failed
2012-08-08 20:11:01 [DEBUG   ] spawn_process: at 2012-08-08 20:11:01 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2012-08-08 20:11:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2012-08-08 20:11:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2012-08-08 20:11:01 [DEBUG   ] spawn_process: at 2012-08-08 20:11:01 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2012-08-08 20:11:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2012-08-08 20:11:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2012-08-08 20:11:01 [DEBUG   ] spawn_process: at 2012-08-08 20:11:01 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2012-08-08 20:11:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2012-08-08 20:11:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2012-08-08 20:11:01 [DEBUG   ] spawn_process: at 2012-08-08 20:11:01 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2012-08-08 20:11:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2012-08-08 20:11:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2012-08-08 20:11:02 [DEBUG   ] Finished updating ant stats in 0.680 seconds
2012-08-08 20:11:02 [INFO    ] Started antennas statistics background thread
2012-08-08 20:11:02 [INFO    ] Started board flags background thread
2012-08-08 20:11:02 [INFO    ] Started BAM background thread
2012-08-08 20:11:02 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 with PID 31013
2012-08-08 20:11:02 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 with PID 31016
2012-08-08 20:11:02 [INFO    ] Finished the INI process in 100.064 s
2012-08-08 20:11:03 [DEBUG   ] Finished updating board flags in 0.821 seconds
2012-08-08 20:11:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 20:11:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 20:11:59 [DEBUG   ] Got command RPT from MCS: ref #7154
2012-08-08 20:11:59 [DEBUG   ] summary = ERROR
2012-08-08 20:11:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7154  13 56147 72719729 A  ERRORERROR'
2012-08-08 20:12:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 20:12:03 [DEBUG   ] Finished updating board flags in 0.825 seconds
2012-08-08 20:12:19 [DEBUG   ] Got command INI from MCS: ref #7155
2012-08-08 20:12:19 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2012-08-08 20:12:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI     7155   8 56147 72739197 ABOOTING'
2012-08-08 20:12:22 [DEBUG   ] Finished updating ant stats in 0.623 seconds
2012-08-08 20:12:36 [INFO    ] -------------------
2012-08-08 20:12:36 [INFO    ]  LWA board status
2012-08-08 20:12:36 [INFO    ] -------------------
2012-08-08 20:12:36 [INFO    ] DP 1: 2 lwa27
2012-08-08 20:12:36 [INFO    ] DP 1: 3 lwa24
2012-08-08 20:12:36 [INFO    ] DP 1: 4 lwa23
2012-08-08 20:12:36 [INFO    ] DP 1: 5 lwa18
2012-08-08 20:12:36 [INFO    ] DP 1: 6 lwa10
2012-08-08 20:12:36 [INFO    ] DP 1: 7 lwa32
2012-08-08 20:12:36 [INFO    ] DP 1: 8 lwa11
2012-08-08 20:12:36 [INFO    ] DP 1: 9 lwa30
2012-08-08 20:12:36 [INFO    ] DP 1: 10 lwa12
2012-08-08 20:12:36 [INFO    ] DP 1: 11 lwa8
2012-08-08 20:12:36 [INFO    ] DP 1: 12 lwa13
2012-08-08 20:12:36 [INFO    ] DP 1: 13 lwa26
2012-08-08 20:12:36 [INFO    ] DP 1: 14 lwa14
2012-08-08 20:12:36 [INFO    ] DP 1: 16 lwa22
2012-08-08 20:12:36 [INFO    ] DP 1: 17 lwa20
2012-08-08 20:12:36 [INFO    ] DP 1: 18 lwa1
2012-08-08 20:12:36 [INFO    ] DP 1: 19 lwa5
2012-08-08 20:12:36 [INFO    ] DP 1: 20 lwa25
2012-08-08 20:12:36 [INFO    ] DP 1: 21 lwa35
2012-08-08 20:12:36 [INFO    ] DP 1: 22 lwa19
2012-08-08 20:12:36 [INFO    ] DP 1: 23 lwa21
2012-08-08 20:12:36 [INFO    ] DP 1: 24 lwa6
2012-08-08 20:12:36 [INFO    ] DP 1: 25 lwa7
2012-08-08 20:12:36 [INFO    ] DP 1: 26 lwa33
2012-08-08 20:12:36 [INFO    ] DP 1: 27 lwa15
2012-08-08 20:12:36 [INFO    ] DP 1: 28 lwa28
2012-08-08 20:12:36 [INFO    ] DP 2: 1 lwa16
2012-08-08 20:12:36 [INFO    ] DP 2: 15 lwa34
2012-08-08 20:12:36 [INFO    ] Total of 28 boards
2012-08-08 20:12:36 [INFO    ] Total of 260 stands
2012-08-08 20:12:36 [INFO    ] -------------------
2012-08-08 20:12:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31477
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31478
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31479
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31480
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31481
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31482
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31483
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31484
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31485
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31486
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31487
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31488
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31489
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31490
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31491
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31492
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31493
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31494
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31495
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31496
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31497
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31498
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31499
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31500
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31501
2012-08-08 20:12:43 [DEBUG   ] 2012-08-08 20:12:43 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 31502
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31477 exited with status 0
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31478 exited with status 0
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31479 exited with status 0
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31480 exited with status 0
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31481 exited with status 0
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31482 exited with status 0
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31483 exited with status 0
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31484 exited with status 0
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31485 exited with status 0
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31486 exited with status 0
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31487 exited with status 0
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31488 exited with status 0
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31489 exited with status 0
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31490 exited with status 0
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31491 exited with status 0
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31492 exited with status 0
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31493 exited with status 0
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31494 exited with status 0
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31495 exited with status 0
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31496 exited with status 0
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31497 exited with status 0
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31498 exited with status 0
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31499 exited with status 0
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31500 exited with status 0
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31501 exited with status 0
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 31502 exited with status 0
2012-08-08 20:12:55 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] spawn_process: at 2012-08-08 20:12:55 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 31529
2012-08-08 20:12:55 [DEBUG   ] 2012-08-08 20:12:55 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 31530
2012-08-08 20:13:01 [DEBUG   ] 2012-08-08 20:13:01 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 31529 exited with status 0
2012-08-08 20:13:01 [DEBUG   ] 2012-08-08 20:13:01 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 31530 exited with status 0
2012-08-08 20:13:01 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2012-08-08 20:13:01 [DEBUG   ] spawn_process: at 2012-08-08 20:13:01 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2012-08-08 20:13:01 [DEBUG   ] spawn_process: at 2012-08-08 20:13:01 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2012-08-08 20:13:01 [INFO    ] Setting Beam 1 xbars
2012-08-08 20:13:01 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2012-08-08 20:13:01 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2012-08-08 20:13:01 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2012-08-08 20:13:01 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2012-08-08 20:13:01 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2012-08-08 20:13:02 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2012-08-08 20:13:02 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2012-08-08 20:13:02 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2012-08-08 20:13:02 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2012-08-08 20:13:02 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2012-08-08 20:13:02 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2012-08-08 20:13:02 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2012-08-08 20:13:02 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2012-08-08 20:13:02 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2012-08-08 20:13:03 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2012-08-08 20:13:03 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2012-08-08 20:13:03 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2012-08-08 20:13:03 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2012-08-08 20:13:03 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2012-08-08 20:13:03 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2012-08-08 20:13:03 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2012-08-08 20:13:03 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2012-08-08 20:13:03 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2012-08-08 20:13:04 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2012-08-08 20:13:04 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2012-08-08 20:13:04 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2012-08-08 20:13:04 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2012-08-08 20:13:04 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2012-08-08 20:13:04 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2012-08-08 20:13:04 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2012-08-08 20:13:04 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2012-08-08 20:13:04 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2012-08-08 20:13:05 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2012-08-08 20:13:05 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2012-08-08 20:13:05 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2012-08-08 20:13:05 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2012-08-08 20:13:05 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2012-08-08 20:13:05 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2012-08-08 20:13:05 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2012-08-08 20:13:05 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2012-08-08 20:13:05 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2012-08-08 20:13:06 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2012-08-08 20:13:06 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2012-08-08 20:13:06 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2012-08-08 20:13:06 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2012-08-08 20:13:06 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2012-08-08 20:13:06 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2012-08-08 20:13:06 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2012-08-08 20:13:06 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2012-08-08 20:13:06 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2012-08-08 20:13:07 [INFO    ] Setting Beam 2 xbars
2012-08-08 20:13:07 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2012-08-08 20:13:07 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2012-08-08 20:13:07 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2012-08-08 20:13:07 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2012-08-08 20:13:07 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2012-08-08 20:13:07 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2012-08-08 20:13:07 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2012-08-08 20:13:07 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2012-08-08 20:13:07 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2012-08-08 20:13:08 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2012-08-08 20:13:08 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2012-08-08 20:13:08 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2012-08-08 20:13:08 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2012-08-08 20:13:08 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2012-08-08 20:13:08 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2012-08-08 20:13:08 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2012-08-08 20:13:08 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2012-08-08 20:13:08 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2012-08-08 20:13:09 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2012-08-08 20:13:09 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2012-08-08 20:13:09 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2012-08-08 20:13:09 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2012-08-08 20:13:09 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2012-08-08 20:13:09 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2012-08-08 20:13:09 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2012-08-08 20:13:09 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2012-08-08 20:13:09 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2012-08-08 20:13:10 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2012-08-08 20:13:10 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2012-08-08 20:13:10 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2012-08-08 20:13:10 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2012-08-08 20:13:10 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2012-08-08 20:13:10 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2012-08-08 20:13:10 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2012-08-08 20:13:10 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2012-08-08 20:13:10 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2012-08-08 20:13:11 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2012-08-08 20:13:11 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2012-08-08 20:13:11 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2012-08-08 20:13:11 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2012-08-08 20:13:11 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2012-08-08 20:13:11 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2012-08-08 20:13:11 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2012-08-08 20:13:11 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2012-08-08 20:13:11 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2012-08-08 20:13:12 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2012-08-08 20:13:12 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2012-08-08 20:13:12 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2012-08-08 20:13:12 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2012-08-08 20:13:12 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2012-08-08 20:13:12 [INFO    ] Setting Beam 3 xbars
2012-08-08 20:13:12 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2012-08-08 20:13:12 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2012-08-08 20:13:12 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2012-08-08 20:13:12 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2012-08-08 20:13:12 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2012-08-08 20:13:13 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2012-08-08 20:13:13 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2012-08-08 20:13:13 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2012-08-08 20:13:13 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2012-08-08 20:13:13 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2012-08-08 20:13:13 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2012-08-08 20:13:13 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2012-08-08 20:13:13 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2012-08-08 20:13:13 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2012-08-08 20:13:14 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2012-08-08 20:13:14 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2012-08-08 20:13:14 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2012-08-08 20:13:14 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2012-08-08 20:13:14 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2012-08-08 20:13:14 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2012-08-08 20:13:14 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2012-08-08 20:13:14 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2012-08-08 20:13:15 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2012-08-08 20:13:15 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2012-08-08 20:13:15 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2012-08-08 20:13:15 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2012-08-08 20:13:15 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2012-08-08 20:13:15 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2012-08-08 20:13:15 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2012-08-08 20:13:15 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2012-08-08 20:13:15 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2012-08-08 20:13:16 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2012-08-08 20:13:16 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2012-08-08 20:13:16 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2012-08-08 20:13:16 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2012-08-08 20:13:16 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2012-08-08 20:13:16 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2012-08-08 20:13:16 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2012-08-08 20:13:16 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2012-08-08 20:13:16 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2012-08-08 20:13:17 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2012-08-08 20:13:17 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2012-08-08 20:13:17 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2012-08-08 20:13:17 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2012-08-08 20:13:17 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2012-08-08 20:13:17 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2012-08-08 20:13:17 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2012-08-08 20:13:17 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2012-08-08 20:13:17 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2012-08-08 20:13:17 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2012-08-08 20:13:18 [INFO    ] Setting Beam 4 xbars
2012-08-08 20:13:18 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2012-08-08 20:13:18 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 20:13:18 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 20:13:18 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 20:13:18 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 20:13:18 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2012-08-08 20:13:18 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2012-08-08 20:13:18 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2012-08-08 20:13:18 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2012-08-08 20:13:19 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2012-08-08 20:13:19 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2012-08-08 20:13:19 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2012-08-08 20:13:19 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2012-08-08 20:13:19 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2012-08-08 20:13:19 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2012-08-08 20:13:19 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2012-08-08 20:13:19 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2012-08-08 20:13:19 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2012-08-08 20:13:20 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2012-08-08 20:13:20 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2012-08-08 20:13:20 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2012-08-08 20:13:20 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2012-08-08 20:13:20 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2012-08-08 20:13:20 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2012-08-08 20:13:20 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2012-08-08 20:13:20 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2012-08-08 20:13:20 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2012-08-08 20:13:21 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2012-08-08 20:13:21 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2012-08-08 20:13:21 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2012-08-08 20:13:21 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2012-08-08 20:13:21 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2012-08-08 20:13:21 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2012-08-08 20:13:21 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2012-08-08 20:13:21 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2012-08-08 20:13:21 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2012-08-08 20:13:22 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2012-08-08 20:13:22 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2012-08-08 20:13:22 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2012-08-08 20:13:22 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2012-08-08 20:13:22 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2012-08-08 20:13:22 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2012-08-08 20:13:22 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2012-08-08 20:13:22 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2012-08-08 20:13:22 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2012-08-08 20:13:22 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2012-08-08 20:13:23 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2012-08-08 20:13:23 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2012-08-08 20:13:23 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2012-08-08 20:13:23 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2012-08-08 20:13:23 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2012-08-08 20:13:23 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2012-08-08 20:13:23 [INFO    ] All xbars set
2012-08-08 20:13:23 [INFO    ] Setting adder chain routing for all beams
2012-08-08 20:13:28 [INFO    ] Setting beam ids
2012-08-08 20:13:38 [INFO    ] Starting beam delay calibration
2012-08-08 20:13:50 [INFO    ] Beam 1 latency is 5713
2012-08-08 20:13:50 [INFO    ] Beam 2 latency is 5763
2012-08-08 20:13:50 [INFO    ] Beam 3 latency is 5746
2012-08-08 20:13:50 [INFO    ] Beam 4 latency is 5724
2012-08-08 20:13:50 [INFO    ] Stop calibration
2012-08-08 20:13:58 [INFO    ] Beam delay calibration successful
2012-08-08 20:13:58 [INFO    ] Calibration passed
2012-08-08 20:13:58 [DEBUG   ] spawn_process: at 2012-08-08 20:13:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2012-08-08 20:13:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2012-08-08 20:13:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2012-08-08 20:13:58 [DEBUG   ] spawn_process: at 2012-08-08 20:13:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2012-08-08 20:13:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2012-08-08 20:13:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2012-08-08 20:13:58 [DEBUG   ] spawn_process: at 2012-08-08 20:13:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2012-08-08 20:13:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2012-08-08 20:13:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2012-08-08 20:13:58 [DEBUG   ] spawn_process: at 2012-08-08 20:13:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2012-08-08 20:13:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2012-08-08 20:13:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2012-08-08 20:13:59 [DEBUG   ] Finished updating ant stats in 0.533 seconds
2012-08-08 20:13:59 [INFO    ] Started antennas statistics background thread
2012-08-08 20:13:59 [INFO    ] Started board flags background thread
2012-08-08 20:13:59 [INFO    ] Started BAM background thread
2012-08-08 20:13:59 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 with PID 653
2012-08-08 20:13:59 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 with PID 656
2012-08-08 20:13:59 [INFO    ] Finished the INI process in 100.756 s
2012-08-08 20:14:00 [DEBUG   ] Finished updating board flags in 0.820 seconds
2012-08-08 20:14:06 [DEBUG   ] Got command RPT from MCS: ref #7156
2012-08-08 20:14:06 [DEBUG   ] summary = NORMAL
2012-08-08 20:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7156  14 56147 72846253 A NORMALNORMAL'
2012-08-08 20:14:06 [DEBUG   ] Got command RPT from MCS: ref #7157
2012-08-08 20:14:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 20:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7157  48 56147 72846253 A NORMALSystem calibrated and operating normally'
2012-08-08 20:14:11 [DEBUG   ] Got command RPT from MCS: ref #7173
2012-08-08 20:14:11 [DEBUG   ] summary = NORMAL
2012-08-08 20:14:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7173  14 56147 72851340 A NORMALNORMAL'
2012-08-08 20:14:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 20:14:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 20:14:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 20:15:00 [DEBUG   ] Finished updating board flags in 0.837 seconds
2012-08-08 20:15:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-08 20:15:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 20:15:43 [DEBUG   ] Got command TBN from MCS: ref #7177
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '1', '1344456945']
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '2', '1344456945']
2012-08-08 20:15:43 [DEBUG   ] tbn = exited with status True, code 0x00
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '3', '1344456945']
2012-08-08 20:15:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN     7177   8 56147 72943741 A NORMAL'
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '4', '1344456945']
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '5', '1344456945']
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '6', '1344456945']
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '7', '1344456945']
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '8', '1344456945']
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '9', '1344456945']
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '10', '1344456945']
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '11', '1344456945']
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '12', '1344456945']
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '13', '1344456945']
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '14', '1344456945']
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '15', '1344456945']
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '16', '1344456945']
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '17', '1344456945']
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '18', '1344456945']
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '19', '1344456945']
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '20', '1344456945']
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '21', '1344456945']
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '22', '1344456945']
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '23', '1344456945']
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '24', '1344456945']
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '25', '1344456945']
2012-08-08 20:15:43 [DEBUG   ] spawn_process: at 2012-08-08 20:15:43 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '26', '1344456945']
2012-08-08 20:15:43 [INFO    ] Finished spawning TBN in 0.039 s
2012-08-08 20:15:59 [DEBUG   ] Finished updating ant stats in 0.470 seconds
2012-08-08 20:16:01 [DEBUG   ] Finished updating board flags in 1.343 seconds
2012-08-08 20:16:20 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2012-08-08 20:16:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 20:17:00 [DEBUG   ] Finished updating ant stats in 1.243 seconds
2012-08-08 20:17:01 [DEBUG   ] Finished updating board flags in 1.311 seconds
2012-08-08 20:17:20 [DEBUG   ] Finished updating ant stats in 1.165 seconds
2012-08-08 20:17:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 20:18:00 [DEBUG   ] Finished updating ant stats in 1.040 seconds
2012-08-08 20:18:01 [DEBUG   ] Finished updating board flags in 1.271 seconds
2012-08-08 20:18:20 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2012-08-08 20:18:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 20:19:00 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2012-08-08 20:19:01 [DEBUG   ] Finished updating board flags in 1.272 seconds
2012-08-08 20:19:06 [DEBUG   ] Got command RPT from MCS: ref #7178
2012-08-08 20:19:06 [DEBUG   ] summary = NORMAL
2012-08-08 20:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7178  14 56147 73146257 A NORMALNORMAL'
2012-08-08 20:19:06 [DEBUG   ] Got command RPT from MCS: ref #7179
2012-08-08 20:19:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 20:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7179  48 56147 73146257 A NORMALSystem calibrated and operating normally'
2012-08-08 20:19:20 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2012-08-08 20:19:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 20:20:00 [DEBUG   ] Finished updating ant stats in 0.643 seconds
2012-08-08 20:20:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 20:20:01 [DEBUG   ] Finished updating board flags in 1.261 seconds
2012-08-08 20:20:20 [DEBUG   ] Finished updating ant stats in 0.565 seconds
2012-08-08 20:20:41 [DEBUG   ] Finished updating ant stats in 1.390 seconds
2012-08-08 20:21:01 [DEBUG   ] Finished updating ant stats in 1.249 seconds
2012-08-08 20:21:01 [DEBUG   ] Finished updating board flags in 1.301 seconds
2012-08-08 20:21:21 [DEBUG   ] Finished updating ant stats in 1.160 seconds
2012-08-08 20:21:41 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-08 20:22:01 [DEBUG   ] Finished updating ant stats in 0.843 seconds
2012-08-08 20:22:01 [DEBUG   ] Finished updating board flags in 1.470 seconds
2012-08-08 20:22:21 [DEBUG   ] Finished updating ant stats in 0.764 seconds
2012-08-08 20:22:41 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 20:23:01 [DEBUG   ] Finished updating board flags in 1.426 seconds
2012-08-08 20:23:02 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2012-08-08 20:23:22 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-08 20:23:42 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-08 20:24:01 [DEBUG   ] Finished updating board flags in 1.383 seconds
2012-08-08 20:24:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 20:24:06 [DEBUG   ] Got command RPT from MCS: ref #7195
2012-08-08 20:24:06 [DEBUG   ] summary = NORMAL
2012-08-08 20:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7195  14 56147 73446249 A NORMALNORMAL'
2012-08-08 20:24:06 [DEBUG   ] Got command RPT from MCS: ref #7196
2012-08-08 20:24:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 20:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7196  48 56147 73446249 A NORMALSystem calibrated and operating normally'
2012-08-08 20:24:22 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 20:24:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 20:25:01 [DEBUG   ] Finished updating board flags in 1.332 seconds
2012-08-08 20:25:02 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 20:25:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 20:25:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 20:26:02 [DEBUG   ] Finished updating board flags in 1.446 seconds
2012-08-08 20:26:02 [DEBUG   ] Finished updating ant stats in 0.637 seconds
2012-08-08 20:26:22 [DEBUG   ] Finished updating ant stats in 0.563 seconds
2012-08-08 20:26:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 20:27:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 20:27:02 [DEBUG   ] Finished updating board flags in 1.676 seconds
2012-08-08 20:27:03 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2012-08-08 20:27:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 20:27:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 20:28:02 [DEBUG   ] Finished updating board flags in 1.344 seconds
2012-08-08 20:28:03 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-08 20:28:23 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 20:28:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-08 20:29:02 [DEBUG   ] Finished updating board flags in 1.352 seconds
2012-08-08 20:29:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 20:29:06 [DEBUG   ] Got command RPT from MCS: ref #7212
2012-08-08 20:29:06 [DEBUG   ] summary = NORMAL
2012-08-08 20:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7212  14 56147 73746249 A NORMALNORMAL'
2012-08-08 20:29:06 [DEBUG   ] Got command RPT from MCS: ref #7213
2012-08-08 20:29:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 20:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7213  48 56147 73746249 A NORMALSystem calibrated and operating normally'
2012-08-08 20:29:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 20:29:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-08 20:30:02 [DEBUG   ] Finished updating board flags in 1.366 seconds
2012-08-08 20:30:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 20:30:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 20:30:43 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-08 20:31:02 [DEBUG   ] Finished updating board flags in 1.533 seconds
2012-08-08 20:31:03 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 20:31:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 20:31:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 20:32:02 [DEBUG   ] Finished updating board flags in 1.271 seconds
2012-08-08 20:32:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 20:32:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 20:32:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 20:33:02 [DEBUG   ] Finished updating board flags in 1.286 seconds
2012-08-08 20:33:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 20:33:24 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-08 20:33:43 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-08 20:34:02 [DEBUG   ] Finished updating board flags in 1.291 seconds
2012-08-08 20:34:04 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-08 20:34:06 [DEBUG   ] Got command RPT from MCS: ref #7229
2012-08-08 20:34:06 [DEBUG   ] summary = NORMAL
2012-08-08 20:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7229  14 56147 74046261 A NORMALNORMAL'
2012-08-08 20:34:06 [DEBUG   ] Got command RPT from MCS: ref #7230
2012-08-08 20:34:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 20:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7230  48 56147 74046261 A NORMALSystem calibrated and operating normally'
2012-08-08 20:34:24 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-08 20:34:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 20:35:03 [DEBUG   ] Finished updating board flags in 1.476 seconds
2012-08-08 20:35:04 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-08 20:35:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 20:35:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-08 20:36:03 [DEBUG   ] Finished updating board flags in 1.334 seconds
2012-08-08 20:36:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 20:36:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 20:36:44 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 20:37:03 [DEBUG   ] Finished updating board flags in 1.243 seconds
2012-08-08 20:37:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 20:37:24 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-08 20:37:44 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-08 20:38:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2012-08-08 20:38:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 20:38:03 [CRITICAL] MGT underflow detected on beam(s) 1
2012-08-08 20:38:03 [DEBUG   ] Finished updating board flags in 1.244 seconds
2012-08-08 20:38:05 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-08 20:38:25 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-08 20:38:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 20:39:03 [DEBUG   ] Finished updating board flags in 1.245 seconds
2012-08-08 20:39:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 20:39:06 [DEBUG   ] Got command RPT from MCS: ref #7246
2012-08-08 20:39:06 [DEBUG   ] summary = ERROR
2012-08-08 20:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7246  13 56147 74346253 A  ERRORERROR'
2012-08-08 20:39:06 [DEBUG   ] Got command RPT from MCS: ref #7247
2012-08-08 20:39:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 20:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7247  77 56147 74346253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 20:39:25 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-08 20:39:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 20:40:03 [DEBUG   ] Finished updating board flags in 1.309 seconds
2012-08-08 20:40:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-08 20:40:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 20:40:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 20:41:03 [DEBUG   ] Finished updating board flags in 1.309 seconds
2012-08-08 20:41:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-08 20:41:25 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-08 20:41:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 20:42:03 [DEBUG   ] Finished updating board flags in 1.300 seconds
2012-08-08 20:42:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 20:42:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 20:42:45 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2012-08-08 20:43:03 [DEBUG   ] Finished updating board flags in 1.472 seconds
2012-08-08 20:43:06 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2012-08-08 20:43:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 20:43:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 20:44:03 [DEBUG   ] Finished updating board flags in 1.298 seconds
2012-08-08 20:44:06 [DEBUG   ] Got command RPT from MCS: ref #7263
2012-08-08 20:44:06 [DEBUG   ] summary = ERROR
2012-08-08 20:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7263  13 56147 74646261 A  ERRORERROR'
2012-08-08 20:44:06 [DEBUG   ] Got command RPT from MCS: ref #7264
2012-08-08 20:44:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 20:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7264  77 56147 74646261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 20:44:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 20:44:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 20:44:46 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-08 20:45:03 [DEBUG   ] Finished updating board flags in 1.233 seconds
2012-08-08 20:45:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 20:45:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 20:45:46 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-08 20:46:03 [DEBUG   ] Finished updating board flags in 1.229 seconds
2012-08-08 20:46:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 20:46:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 20:46:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 20:47:03 [DEBUG   ] Finished updating board flags in 1.226 seconds
2012-08-08 20:47:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 20:47:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 20:47:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 20:48:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 20:48:03 [DEBUG   ] Finished updating board flags in 1.232 seconds
2012-08-08 20:48:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 20:48:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 20:48:46 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-08 20:49:03 [DEBUG   ] Finished updating board flags in 1.258 seconds
2012-08-08 20:49:06 [DEBUG   ] Got command RPT from MCS: ref #7280
2012-08-08 20:49:06 [DEBUG   ] summary = ERROR
2012-08-08 20:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7280  13 56147 74946257 A  ERRORERROR'
2012-08-08 20:49:06 [DEBUG   ] Got command RPT from MCS: ref #7281
2012-08-08 20:49:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 20:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7281  77 56147 74946257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 20:49:07 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-08 20:49:26 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 20:49:47 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-08 20:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2012-08-08 20:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2012-08-08 20:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2012-08-08 20:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2012-08-08 20:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2012-08-08 20:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2012-08-08 20:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2012-08-08 20:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2012-08-08 20:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2012-08-08 20:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2012-08-08 20:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2012-08-08 20:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2012-08-08 20:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2012-08-08 20:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2012-08-08 20:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2012-08-08 20:50:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 20:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2012-08-08 20:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2012-08-08 20:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2012-08-08 20:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2012-08-08 20:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2012-08-08 20:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2012-08-08 20:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2012-08-08 20:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2012-08-08 20:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2012-08-08 20:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2012-08-08 20:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2012-08-08 20:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2012-08-08 20:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2012-08-08 20:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2012-08-08 20:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2012-08-08 20:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2012-08-08 20:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2012-08-08 20:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2012-08-08 20:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2012-08-08 20:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2012-08-08 20:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2012-08-08 20:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2012-08-08 20:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2012-08-08 20:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2012-08-08 20:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2012-08-08 20:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2012-08-08 20:50:04 [DEBUG   ] Finished updating board flags in 1.465 seconds
2012-08-08 20:50:07 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-08 20:50:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-08 20:50:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 20:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2012-08-08 20:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2012-08-08 20:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2012-08-08 20:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2012-08-08 20:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2012-08-08 20:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2012-08-08 20:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2012-08-08 20:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2012-08-08 20:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2012-08-08 20:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2012-08-08 20:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2012-08-08 20:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2012-08-08 20:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2012-08-08 20:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2012-08-08 20:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2012-08-08 20:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2012-08-08 20:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2012-08-08 20:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2012-08-08 20:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2012-08-08 20:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2012-08-08 20:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2012-08-08 20:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2012-08-08 20:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2012-08-08 20:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2012-08-08 20:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2012-08-08 20:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2012-08-08 20:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2012-08-08 20:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2012-08-08 20:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2012-08-08 20:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2012-08-08 20:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2012-08-08 20:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2012-08-08 20:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2012-08-08 20:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2012-08-08 20:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2012-08-08 20:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2012-08-08 20:51:04 [DEBUG   ] Finished updating board flags in 1.380 seconds
2012-08-08 20:51:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 20:51:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 20:51:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 20:52:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 20:52:04 [DEBUG   ] Finished updating board flags in 1.244 seconds
2012-08-08 20:52:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 20:52:07 [DEBUG   ] Got command INI from MCS: ref #7297
2012-08-08 20:52:07 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2012-08-08 20:52:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI     7297   8 56147 75127380 ABOOTING'
2012-08-08 20:52:27 [INFO    ] -------------------
2012-08-08 20:52:27 [INFO    ]  LWA board status
2012-08-08 20:52:27 [INFO    ] -------------------
2012-08-08 20:52:27 [INFO    ] DP 1: 2 lwa27
2012-08-08 20:52:27 [INFO    ] DP 1: 3 lwa24
2012-08-08 20:52:27 [INFO    ] DP 1: 4 lwa23
2012-08-08 20:52:27 [INFO    ] DP 1: 5 lwa18
2012-08-08 20:52:27 [INFO    ] DP 1: 6 lwa10
2012-08-08 20:52:27 [INFO    ] DP 1: 7 lwa32
2012-08-08 20:52:27 [INFO    ] DP 1: 8 lwa11
2012-08-08 20:52:27 [INFO    ] DP 1: 9 lwa30
2012-08-08 20:52:27 [INFO    ] DP 1: 10 lwa12
2012-08-08 20:52:27 [INFO    ] DP 1: 11 lwa8
2012-08-08 20:52:27 [INFO    ] DP 1: 12 lwa13
2012-08-08 20:52:27 [INFO    ] DP 1: 13 lwa26
2012-08-08 20:52:27 [INFO    ] DP 1: 14 lwa14
2012-08-08 20:52:27 [INFO    ] DP 1: 16 lwa22
2012-08-08 20:52:27 [INFO    ] DP 1: 17 lwa20
2012-08-08 20:52:27 [INFO    ] DP 1: 18 lwa1
2012-08-08 20:52:27 [INFO    ] DP 1: 19 lwa5
2012-08-08 20:52:27 [INFO    ] DP 1: 20 lwa25
2012-08-08 20:52:27 [INFO    ] DP 1: 21 lwa35
2012-08-08 20:52:27 [INFO    ] DP 1: 22 lwa19
2012-08-08 20:52:27 [INFO    ] DP 1: 23 lwa21
2012-08-08 20:52:27 [INFO    ] DP 1: 24 lwa6
2012-08-08 20:52:27 [INFO    ] DP 1: 25 lwa7
2012-08-08 20:52:27 [INFO    ] DP 1: 26 lwa33
2012-08-08 20:52:27 [INFO    ] DP 1: 27 lwa15
2012-08-08 20:52:27 [INFO    ] DP 1: 28 lwa28
2012-08-08 20:52:27 [INFO    ] DP 2: 1 lwa16
2012-08-08 20:52:27 [INFO    ] DP 2: 15 lwa34
2012-08-08 20:52:27 [INFO    ] Total of 28 boards
2012-08-08 20:52:27 [INFO    ] Total of 260 stands
2012-08-08 20:52:27 [INFO    ] -------------------
2012-08-08 20:52:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5235
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5236
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5237
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5238
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5239
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5240
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5241
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5242
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5243
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5244
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5245
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5246
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5247
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5248
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5249
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5250
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5251
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5252
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5253
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5254
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5255
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5256
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5257
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5258
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5259
2012-08-08 20:52:34 [DEBUG   ] 2012-08-08 20:52:34 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5260
2012-08-08 20:52:46 [DEBUG   ] 2012-08-08 20:52:46 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5235 exited with status 0
2012-08-08 20:52:46 [DEBUG   ] 2012-08-08 20:52:46 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5236 exited with status 0
2012-08-08 20:52:46 [DEBUG   ] 2012-08-08 20:52:46 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5237 exited with status 0
2012-08-08 20:52:46 [DEBUG   ] 2012-08-08 20:52:46 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5238 exited with status 0
2012-08-08 20:52:46 [DEBUG   ] 2012-08-08 20:52:46 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5239 exited with status 0
2012-08-08 20:52:46 [DEBUG   ] 2012-08-08 20:52:46 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5240 exited with status 0
2012-08-08 20:52:46 [DEBUG   ] 2012-08-08 20:52:46 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5241 exited with status 0
2012-08-08 20:52:46 [DEBUG   ] 2012-08-08 20:52:46 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5242 exited with status 0
2012-08-08 20:52:46 [DEBUG   ] 2012-08-08 20:52:46 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5243 exited with status 0
2012-08-08 20:52:46 [DEBUG   ] 2012-08-08 20:52:46 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5244 exited with status 0
2012-08-08 20:52:46 [DEBUG   ] 2012-08-08 20:52:46 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5245 exited with status 0
2012-08-08 20:52:46 [DEBUG   ] 2012-08-08 20:52:46 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5246 exited with status 0
2012-08-08 20:52:46 [DEBUG   ] 2012-08-08 20:52:46 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5247 exited with status 0
2012-08-08 20:52:46 [DEBUG   ] 2012-08-08 20:52:46 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5248 exited with status 0
2012-08-08 20:52:47 [DEBUG   ] 2012-08-08 20:52:47 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5249 exited with status 0
2012-08-08 20:52:47 [DEBUG   ] 2012-08-08 20:52:47 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5250 exited with status 0
2012-08-08 20:52:47 [DEBUG   ] 2012-08-08 20:52:47 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5251 exited with status 0
2012-08-08 20:52:47 [DEBUG   ] 2012-08-08 20:52:47 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5252 exited with status 0
2012-08-08 20:52:47 [DEBUG   ] 2012-08-08 20:52:47 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5253 exited with status 0
2012-08-08 20:52:47 [DEBUG   ] 2012-08-08 20:52:47 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5254 exited with status 0
2012-08-08 20:52:47 [DEBUG   ] 2012-08-08 20:52:47 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5255 exited with status 0
2012-08-08 20:52:47 [DEBUG   ] 2012-08-08 20:52:47 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5256 exited with status 0
2012-08-08 20:52:47 [DEBUG   ] 2012-08-08 20:52:47 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5257 exited with status 0
2012-08-08 20:52:47 [DEBUG   ] 2012-08-08 20:52:47 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5258 exited with status 0
2012-08-08 20:52:47 [DEBUG   ] 2012-08-08 20:52:47 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5259 exited with status 0
2012-08-08 20:52:47 [DEBUG   ] 2012-08-08 20:52:47 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5260 exited with status 0
2012-08-08 20:52:47 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] spawn_process: at 2012-08-08 20:52:47 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2012-08-08 20:52:47 [DEBUG   ] 2012-08-08 20:52:47 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 5287
2012-08-08 20:52:47 [DEBUG   ] 2012-08-08 20:52:47 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 5288
2012-08-08 20:52:52 [DEBUG   ] 2012-08-08 20:52:52 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 5287 exited with status 0
2012-08-08 20:52:52 [DEBUG   ] 2012-08-08 20:52:52 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 5288 exited with status 0
2012-08-08 20:52:52 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2012-08-08 20:52:52 [DEBUG   ] spawn_process: at 2012-08-08 20:52:52 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2012-08-08 20:52:52 [DEBUG   ] spawn_process: at 2012-08-08 20:52:52 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2012-08-08 20:52:52 [INFO    ] Setting Beam 1 xbars
2012-08-08 20:52:52 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2012-08-08 20:52:52 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2012-08-08 20:52:52 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2012-08-08 20:52:52 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2012-08-08 20:52:53 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2012-08-08 20:52:53 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2012-08-08 20:52:53 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2012-08-08 20:52:53 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2012-08-08 20:52:53 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2012-08-08 20:52:53 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2012-08-08 20:52:53 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2012-08-08 20:52:53 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2012-08-08 20:52:53 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2012-08-08 20:52:54 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2012-08-08 20:52:54 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2012-08-08 20:52:54 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2012-08-08 20:52:54 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2012-08-08 20:52:54 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2012-08-08 20:52:54 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2012-08-08 20:52:54 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2012-08-08 20:52:54 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2012-08-08 20:52:54 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2012-08-08 20:52:55 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2012-08-08 20:52:55 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2012-08-08 20:52:55 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2012-08-08 20:52:55 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2012-08-08 20:52:55 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2012-08-08 20:52:55 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2012-08-08 20:52:55 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2012-08-08 20:52:55 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2012-08-08 20:52:55 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2012-08-08 20:52:56 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2012-08-08 20:52:56 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2012-08-08 20:52:56 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2012-08-08 20:52:56 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2012-08-08 20:52:56 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2012-08-08 20:52:56 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2012-08-08 20:52:56 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2012-08-08 20:52:56 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2012-08-08 20:52:56 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2012-08-08 20:52:57 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2012-08-08 20:52:57 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2012-08-08 20:52:57 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2012-08-08 20:52:57 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2012-08-08 20:52:57 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2012-08-08 20:52:57 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2012-08-08 20:52:57 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2012-08-08 20:52:57 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2012-08-08 20:52:57 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2012-08-08 20:52:57 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2012-08-08 20:52:58 [INFO    ] Setting Beam 2 xbars
2012-08-08 20:52:58 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2012-08-08 20:52:58 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2012-08-08 20:52:58 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2012-08-08 20:52:58 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2012-08-08 20:52:58 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2012-08-08 20:52:58 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2012-08-08 20:52:58 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2012-08-08 20:52:58 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2012-08-08 20:52:58 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2012-08-08 20:52:59 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2012-08-08 20:52:59 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2012-08-08 20:52:59 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2012-08-08 20:52:59 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2012-08-08 20:52:59 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2012-08-08 20:52:59 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2012-08-08 20:52:59 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2012-08-08 20:52:59 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2012-08-08 20:52:59 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2012-08-08 20:53:00 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2012-08-08 20:53:00 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2012-08-08 20:53:00 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2012-08-08 20:53:00 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2012-08-08 20:53:00 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2012-08-08 20:53:00 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2012-08-08 20:53:00 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2012-08-08 20:53:00 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2012-08-08 20:53:00 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2012-08-08 20:53:01 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2012-08-08 20:53:01 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2012-08-08 20:53:01 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2012-08-08 20:53:01 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2012-08-08 20:53:01 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2012-08-08 20:53:01 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2012-08-08 20:53:01 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2012-08-08 20:53:01 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2012-08-08 20:53:01 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2012-08-08 20:53:02 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2012-08-08 20:53:02 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2012-08-08 20:53:02 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2012-08-08 20:53:02 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2012-08-08 20:53:02 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2012-08-08 20:53:02 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2012-08-08 20:53:02 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2012-08-08 20:53:02 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2012-08-08 20:53:02 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2012-08-08 20:53:02 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2012-08-08 20:53:03 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2012-08-08 20:53:03 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2012-08-08 20:53:03 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2012-08-08 20:53:03 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2012-08-08 20:53:03 [INFO    ] Setting Beam 3 xbars
2012-08-08 20:53:03 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2012-08-08 20:53:03 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2012-08-08 20:53:03 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2012-08-08 20:53:03 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2012-08-08 20:53:03 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2012-08-08 20:53:04 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2012-08-08 20:53:04 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2012-08-08 20:53:04 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2012-08-08 20:53:04 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2012-08-08 20:53:04 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2012-08-08 20:53:04 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2012-08-08 20:53:04 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2012-08-08 20:53:04 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2012-08-08 20:53:04 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2012-08-08 20:53:05 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2012-08-08 20:53:05 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2012-08-08 20:53:05 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2012-08-08 20:53:05 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2012-08-08 20:53:05 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2012-08-08 20:53:05 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2012-08-08 20:53:05 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2012-08-08 20:53:05 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2012-08-08 20:53:05 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2012-08-08 20:53:06 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2012-08-08 20:53:06 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2012-08-08 20:53:06 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2012-08-08 20:53:06 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2012-08-08 20:53:06 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2012-08-08 20:53:06 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2012-08-08 20:53:06 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2012-08-08 20:53:06 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2012-08-08 20:53:06 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2012-08-08 20:53:07 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2012-08-08 20:53:07 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2012-08-08 20:53:07 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2012-08-08 20:53:07 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2012-08-08 20:53:07 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2012-08-08 20:53:07 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2012-08-08 20:53:07 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2012-08-08 20:53:07 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2012-08-08 20:53:07 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2012-08-08 20:53:08 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2012-08-08 20:53:08 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2012-08-08 20:53:08 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2012-08-08 20:53:08 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2012-08-08 20:53:08 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2012-08-08 20:53:08 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2012-08-08 20:53:08 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2012-08-08 20:53:08 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2012-08-08 20:53:08 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2012-08-08 20:53:09 [INFO    ] Setting Beam 4 xbars
2012-08-08 20:53:09 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2012-08-08 20:53:09 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 20:53:09 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 20:53:09 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 20:53:09 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 20:53:09 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2012-08-08 20:53:09 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2012-08-08 20:53:09 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2012-08-08 20:53:09 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2012-08-08 20:53:10 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2012-08-08 20:53:10 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2012-08-08 20:53:10 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2012-08-08 20:53:10 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2012-08-08 20:53:10 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2012-08-08 20:53:10 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2012-08-08 20:53:10 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2012-08-08 20:53:10 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2012-08-08 20:53:10 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2012-08-08 20:53:10 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2012-08-08 20:53:11 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2012-08-08 20:53:11 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2012-08-08 20:53:11 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2012-08-08 20:53:11 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2012-08-08 20:53:11 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2012-08-08 20:53:11 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2012-08-08 20:53:11 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2012-08-08 20:53:11 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2012-08-08 20:53:11 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2012-08-08 20:53:12 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2012-08-08 20:53:12 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2012-08-08 20:53:12 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2012-08-08 20:53:12 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2012-08-08 20:53:12 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2012-08-08 20:53:12 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2012-08-08 20:53:12 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2012-08-08 20:53:12 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2012-08-08 20:53:12 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2012-08-08 20:53:13 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2012-08-08 20:53:13 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2012-08-08 20:53:13 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2012-08-08 20:53:13 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2012-08-08 20:53:13 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2012-08-08 20:53:13 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2012-08-08 20:53:13 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2012-08-08 20:53:13 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2012-08-08 20:53:13 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2012-08-08 20:53:14 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2012-08-08 20:53:14 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2012-08-08 20:53:14 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2012-08-08 20:53:14 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2012-08-08 20:53:14 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2012-08-08 20:53:14 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2012-08-08 20:53:14 [INFO    ] All xbars set
2012-08-08 20:53:14 [INFO    ] Setting adder chain routing for all beams
2012-08-08 20:53:15 [DEBUG   ] Got command RPT from MCS: ref #7298
2012-08-08 20:53:15 [DEBUG   ] summary = BOOTING
2012-08-08 20:53:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7298  15 56147 75195409 ABOOTINGBOOTING'
2012-08-08 20:53:19 [INFO    ] Setting beam ids
2012-08-08 20:53:29 [INFO    ] Starting beam delay calibration
2012-08-08 20:53:41 [INFO    ] Beam 1 latency is 5707
2012-08-08 20:53:41 [INFO    ] Beam 2 latency is 5777
2012-08-08 20:53:41 [INFO    ] Beam 3 latency is 5762
2012-08-08 20:53:41 [INFO    ] Beam 4 latency is 5726
2012-08-08 20:53:41 [INFO    ] Stop calibration
2012-08-08 20:53:49 [INFO    ] Beam delay calibration successful
2012-08-08 20:53:49 [INFO    ] Calibration passed
2012-08-08 20:53:49 [DEBUG   ] spawn_process: at 2012-08-08 20:53:49 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2012-08-08 20:53:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2012-08-08 20:53:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2012-08-08 20:53:49 [DEBUG   ] spawn_process: at 2012-08-08 20:53:49 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2012-08-08 20:53:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2012-08-08 20:53:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2012-08-08 20:53:49 [DEBUG   ] spawn_process: at 2012-08-08 20:53:49 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2012-08-08 20:53:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2012-08-08 20:53:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2012-08-08 20:53:49 [DEBUG   ] spawn_process: at 2012-08-08 20:53:49 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2012-08-08 20:53:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2012-08-08 20:53:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2012-08-08 20:53:50 [DEBUG   ] Finished updating ant stats in 0.521 seconds
2012-08-08 20:53:50 [INFO    ] Started antennas statistics background thread
2012-08-08 20:53:50 [INFO    ] Started board flags background thread
2012-08-08 20:53:50 [INFO    ] Started BAM background thread
2012-08-08 20:53:50 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 with PID 6879
2012-08-08 20:53:50 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 with PID 6882
2012-08-08 20:53:50 [INFO    ] Finished the INI process in 103.587 s
2012-08-08 20:53:51 [DEBUG   ] Finished updating board flags in 0.820 seconds
2012-08-08 20:53:59 [DEBUG   ] Got command RPT from MCS: ref #7299
2012-08-08 20:53:59 [DEBUG   ] summary = NORMAL
2012-08-08 20:53:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7299  14 56147 75239816 A NORMALNORMAL'
2012-08-08 20:54:06 [DEBUG   ] Got command RPT from MCS: ref #7300
2012-08-08 20:54:06 [DEBUG   ] summary = NORMAL
2012-08-08 20:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7300  14 56147 75246265 A NORMALNORMAL'
2012-08-08 20:54:06 [DEBUG   ] Got command RPT from MCS: ref #7301
2012-08-08 20:54:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 20:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7301  48 56147 75246265 A NORMALSystem calibrated and operating normally'
2012-08-08 20:54:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 20:54:30 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 20:54:50 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 20:54:51 [DEBUG   ] Finished updating board flags in 0.824 seconds
2012-08-08 20:55:09 [DEBUG   ] Got command TBN from MCS: ref #7321
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '1', '1344459311']
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '2', '1344459311']
2012-08-08 20:55:09 [DEBUG   ] tbn = exited with status True, code 0x00
2012-08-08 20:55:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN     7321   8 56147 75309525 A NORMAL'
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '3', '1344459311']
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '4', '1344459311']
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '5', '1344459311']
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '6', '1344459311']
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '7', '1344459311']
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '8', '1344459311']
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '9', '1344459311']
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '10', '1344459311']
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '11', '1344459311']
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '12', '1344459311']
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '13', '1344459311']
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '14', '1344459311']
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '15', '1344459311']
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '16', '1344459311']
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '17', '1344459311']
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '18', '1344459311']
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '19', '1344459311']
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '20', '1344459311']
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '21', '1344459311']
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '22', '1344459311']
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '23', '1344459311']
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '24', '1344459311']
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '25', '1344459311']
2012-08-08 20:55:09 [DEBUG   ] spawn_process: at 2012-08-08 20:55:09 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '26', '1344459311']
2012-08-08 20:55:09 [INFO    ] Finished spawning TBN in 0.048 s
2012-08-08 20:55:10 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 20:55:30 [DEBUG   ] Finished updating ant stats in 0.468 seconds
2012-08-08 20:55:51 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2012-08-08 20:55:52 [DEBUG   ] Finished updating board flags in 1.335 seconds
2012-08-08 20:56:11 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-08 20:56:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 20:56:51 [DEBUG   ] Finished updating ant stats in 1.239 seconds
2012-08-08 20:56:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 20:56:52 [DEBUG   ] Finished updating board flags in 1.289 seconds
2012-08-08 20:57:11 [DEBUG   ] Finished updating ant stats in 1.162 seconds
2012-08-08 20:57:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-08 20:57:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 20:57:51 [DEBUG   ] Finished updating ant stats in 1.045 seconds
2012-08-08 20:57:52 [DEBUG   ] Finished updating board flags in 1.268 seconds
2012-08-08 20:58:11 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2012-08-08 20:58:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 20:58:51 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2012-08-08 20:58:52 [DEBUG   ] Finished updating board flags in 1.270 seconds
2012-08-08 20:59:06 [DEBUG   ] Got command RPT from MCS: ref #7322
2012-08-08 20:59:06 [DEBUG   ] summary = NORMAL
2012-08-08 20:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7322  14 56147 75546261 A NORMALNORMAL'
2012-08-08 20:59:06 [DEBUG   ] Got command RPT from MCS: ref #7323
2012-08-08 20:59:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 20:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7323  48 56147 75546261 A NORMALSystem calibrated and operating normally'
2012-08-08 20:59:11 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2012-08-08 20:59:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 20:59:51 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2012-08-08 20:59:52 [DEBUG   ] Finished updating board flags in 1.254 seconds
2012-08-08 21:00:11 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2012-08-08 21:00:32 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-08 21:00:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 21:00:52 [DEBUG   ] Finished updating ant stats in 1.246 seconds
2012-08-08 21:00:52 [DEBUG   ] Finished updating board flags in 1.307 seconds
2012-08-08 21:01:12 [DEBUG   ] Finished updating ant stats in 1.164 seconds
2012-08-08 21:01:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 21:01:52 [DEBUG   ] Finished updating ant stats in 0.840 seconds
2012-08-08 21:01:52 [DEBUG   ] Finished updating board flags in 1.498 seconds
2012-08-08 21:02:12 [DEBUG   ] Finished updating ant stats in 0.763 seconds
2012-08-08 21:02:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 21:02:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 21:02:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-08 21:02:52 [DEBUG   ] Finished updating ant stats in 0.639 seconds
2012-08-08 21:02:52 [DEBUG   ] Finished updating board flags in 1.448 seconds
2012-08-08 21:03:12 [DEBUG   ] Finished updating ant stats in 0.562 seconds
2012-08-08 21:03:33 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-08 21:03:52 [DEBUG   ] Finished updating board flags in 1.340 seconds
2012-08-08 21:03:53 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-08 21:04:06 [DEBUG   ] Got command RPT from MCS: ref #7339
2012-08-08 21:04:06 [DEBUG   ] summary = NORMAL
2012-08-08 21:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7339  14 56147 75846261 A NORMALNORMAL'
2012-08-08 21:04:06 [DEBUG   ] Got command RPT from MCS: ref #7340
2012-08-08 21:04:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 21:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7340  48 56147 75846261 A NORMALSystem calibrated and operating normally'
2012-08-08 21:04:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 21:04:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 21:04:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 21:04:52 [DEBUG   ] Finished updating board flags in 1.307 seconds
2012-08-08 21:04:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 21:05:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 21:05:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 21:05:53 [DEBUG   ] Finished updating board flags in 1.458 seconds
2012-08-08 21:05:53 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-08 21:06:13 [DEBUG   ] Finished updating ant stats in 1.192 seconds
2012-08-08 21:06:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 21:06:53 [DEBUG   ] Finished updating board flags in 1.431 seconds
2012-08-08 21:06:53 [DEBUG   ] Finished updating ant stats in 0.839 seconds
2012-08-08 21:07:13 [DEBUG   ] Finished updating ant stats in 0.766 seconds
2012-08-08 21:07:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 21:07:53 [DEBUG   ] Finished updating board flags in 1.462 seconds
2012-08-08 21:07:53 [DEBUG   ] Finished updating ant stats in 0.640 seconds
2012-08-08 21:08:13 [DEBUG   ] Finished updating ant stats in 0.565 seconds
2012-08-08 21:08:34 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-08 21:08:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2012-08-08 21:08:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 21:08:53 [DEBUG   ] Finished updating board flags in 1.426 seconds
2012-08-08 21:08:54 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-08 21:09:06 [DEBUG   ] Got command RPT from MCS: ref #7356
2012-08-08 21:09:06 [DEBUG   ] summary = NORMAL
2012-08-08 21:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7356  14 56147 76146257 A NORMALNORMAL'
2012-08-08 21:09:06 [DEBUG   ] Got command RPT from MCS: ref #7357
2012-08-08 21:09:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 21:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7357  48 56147 76146257 A NORMALSystem calibrated and operating normally'
2012-08-08 21:09:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 21:09:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 21:09:53 [DEBUG   ] Finished updating board flags in 1.409 seconds
2012-08-08 21:09:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 21:10:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 21:10:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 21:10:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2012-08-08 21:10:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2012-08-08 21:10:53 [CRITICAL] MGT underflow detected on beam(s) 1
2012-08-08 21:10:53 [DEBUG   ] Finished updating board flags in 1.399 seconds
2012-08-08 21:10:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 21:11:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 21:11:34 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 21:11:53 [DEBUG   ] Finished updating board flags in 1.397 seconds
2012-08-08 21:11:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 21:12:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 21:12:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 21:12:53 [DEBUG   ] Finished updating board flags in 1.406 seconds
2012-08-08 21:12:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 21:13:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 21:13:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 21:13:52 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 21:13:53 [DEBUG   ] Finished updating board flags in 1.276 seconds
2012-08-08 21:13:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 21:14:06 [DEBUG   ] Got command RPT from MCS: ref #7373
2012-08-08 21:14:06 [DEBUG   ] summary = ERROR
2012-08-08 21:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7373  13 56147 76446269 A  ERRORERROR'
2012-08-08 21:14:06 [DEBUG   ] Got command RPT from MCS: ref #7374
2012-08-08 21:14:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 21:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7374  77 56147 76446269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 21:14:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-08 21:14:35 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2012-08-08 21:14:53 [DEBUG   ] Finished updating board flags in 1.462 seconds
2012-08-08 21:14:55 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-08 21:15:15 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-08 21:15:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 21:15:53 [DEBUG   ] Finished updating board flags in 1.317 seconds
2012-08-08 21:15:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 21:16:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 21:16:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 21:16:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 21:16:53 [DEBUG   ] Finished updating board flags in 1.236 seconds
2012-08-08 21:16:55 [DEBUG   ] Finished updating ant stats in 1.097 seconds
2012-08-08 21:17:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 21:17:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 21:17:53 [DEBUG   ] Finished updating board flags in 1.273 seconds
2012-08-08 21:17:55 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2012-08-08 21:18:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 21:18:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 21:18:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 21:18:53 [DEBUG   ] Finished updating board flags in 1.280 seconds
2012-08-08 21:18:55 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 21:19:06 [DEBUG   ] Got command RPT from MCS: ref #7390
2012-08-08 21:19:06 [DEBUG   ] summary = ERROR
2012-08-08 21:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7390  13 56147 76746265 A  ERRORERROR'
2012-08-08 21:19:06 [DEBUG   ] Got command RPT from MCS: ref #7391
2012-08-08 21:19:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 21:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7391  77 56147 76746265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 21:19:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 21:19:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 21:19:54 [DEBUG   ] Finished updating board flags in 1.445 seconds
2012-08-08 21:19:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 21:20:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 21:20:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 21:20:54 [DEBUG   ] Finished updating board flags in 1.372 seconds
2012-08-08 21:20:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 21:21:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 21:21:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 21:21:54 [DEBUG   ] Finished updating board flags in 1.271 seconds
2012-08-08 21:21:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 21:22:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 21:22:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 21:22:54 [DEBUG   ] Finished updating board flags in 1.275 seconds
2012-08-08 21:22:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 21:23:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 21:23:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 21:23:54 [DEBUG   ] Finished updating board flags in 1.391 seconds
2012-08-08 21:23:55 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2012-08-08 21:24:06 [DEBUG   ] Got command RPT from MCS: ref #7407
2012-08-08 21:24:06 [DEBUG   ] summary = ERROR
2012-08-08 21:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7407  13 56147 77046265 A  ERRORERROR'
2012-08-08 21:24:06 [DEBUG   ] Got command RPT from MCS: ref #7408
2012-08-08 21:24:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 21:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7408  77 56147 77046265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 21:24:16 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2012-08-08 21:24:36 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-08 21:24:54 [DEBUG   ] Finished updating board flags in 1.392 seconds
2012-08-08 21:24:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-08 21:25:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 21:25:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 21:25:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2012-08-08 21:25:54 [CRITICAL] MGT underflow detected on beam(s) 1
2012-08-08 21:25:54 [DEBUG   ] Finished updating board flags in 1.465 seconds
2012-08-08 21:25:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 21:26:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-08 21:26:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 21:26:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 21:26:54 [DEBUG   ] Finished updating board flags in 1.279 seconds
2012-08-08 21:26:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 21:27:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 21:27:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 21:27:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 21:27:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 21:27:54 [DEBUG   ] Finished updating board flags in 1.316 seconds
2012-08-08 21:27:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 21:28:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 21:28:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 21:28:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2012-08-08 21:28:55 [CRITICAL] MGT underflow detected on beam(s) 1
2012-08-08 21:28:55 [DEBUG   ] Finished updating board flags in 1.518 seconds
2012-08-08 21:28:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 21:29:06 [DEBUG   ] Got command RPT from MCS: ref #7424
2012-08-08 21:29:06 [DEBUG   ] summary = ERROR
2012-08-08 21:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7424  13 56147 77346265 A  ERRORERROR'
2012-08-08 21:29:06 [DEBUG   ] Got command RPT from MCS: ref #7425
2012-08-08 21:29:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 21:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7425  77 56147 77346265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 21:29:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 21:29:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 21:29:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 21:29:55 [DEBUG   ] Finished updating board flags in 1.324 seconds
2012-08-08 21:29:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 21:30:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 21:30:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 21:30:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 21:30:55 [DEBUG   ] Finished updating board flags in 1.258 seconds
2012-08-08 21:30:56 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2012-08-08 21:31:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 21:31:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 21:31:55 [DEBUG   ] Finished updating board flags in 1.264 seconds
2012-08-08 21:31:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 21:32:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 21:32:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 21:32:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 21:32:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 21:32:55 [DEBUG   ] Finished updating board flags in 1.358 seconds
2012-08-08 21:32:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 21:33:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 21:33:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 21:33:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 21:33:55 [DEBUG   ] Finished updating board flags in 1.403 seconds
2012-08-08 21:33:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 21:34:06 [DEBUG   ] Got command RPT from MCS: ref #7441
2012-08-08 21:34:06 [DEBUG   ] summary = ERROR
2012-08-08 21:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7441  13 56147 77646264 A  ERRORERROR'
2012-08-08 21:34:06 [DEBUG   ] Got command RPT from MCS: ref #7442
2012-08-08 21:34:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 21:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7442  77 56147 77646265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 21:34:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 21:34:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 21:34:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 21:34:55 [DEBUG   ] Finished updating board flags in 1.211 seconds
2012-08-08 21:34:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 21:35:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 21:35:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 21:35:55 [DEBUG   ] Finished updating board flags in 1.313 seconds
2012-08-08 21:35:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 21:36:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 21:36:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 21:36:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 21:36:55 [DEBUG   ] Finished updating board flags in 1.541 seconds
2012-08-08 21:36:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 21:37:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 21:37:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 21:37:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 21:37:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 21:37:55 [DEBUG   ] Finished updating board flags in 1.412 seconds
2012-08-08 21:37:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 21:38:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 21:38:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 21:38:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 21:38:55 [DEBUG   ] Finished updating board flags in 1.526 seconds
2012-08-08 21:38:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 21:39:06 [DEBUG   ] Got command RPT from MCS: ref #7458
2012-08-08 21:39:06 [DEBUG   ] summary = ERROR
2012-08-08 21:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7458  13 56147 77946269 A  ERRORERROR'
2012-08-08 21:39:06 [DEBUG   ] Got command RPT from MCS: ref #7459
2012-08-08 21:39:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 21:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7459  77 56147 77946269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 21:39:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 21:39:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 21:39:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 21:39:56 [DEBUG   ] Finished updating board flags in 1.708 seconds
2012-08-08 21:39:56 [DEBUG   ] Finished updating ant stats in 0.649 seconds
2012-08-08 21:40:16 [DEBUG   ] Finished updating ant stats in 0.553 seconds
2012-08-08 21:40:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 21:40:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-08 21:40:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 21:40:56 [DEBUG   ] Finished updating board flags in 1.502 seconds
2012-08-08 21:40:57 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-08 21:41:17 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-08 21:41:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 21:41:56 [DEBUG   ] Finished updating board flags in 1.419 seconds
2012-08-08 21:41:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 21:42:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 21:42:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 21:42:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 21:42:56 [DEBUG   ] Finished updating board flags in 1.426 seconds
2012-08-08 21:42:57 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2012-08-08 21:43:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 21:43:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 21:43:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 21:43:56 [DEBUG   ] Finished updating board flags in 1.408 seconds
2012-08-08 21:43:57 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2012-08-08 21:44:06 [DEBUG   ] Got command RPT from MCS: ref #7475
2012-08-08 21:44:06 [DEBUG   ] summary = ERROR
2012-08-08 21:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7475  13 56147 78246269 A  ERRORERROR'
2012-08-08 21:44:06 [DEBUG   ] Got command RPT from MCS: ref #7476
2012-08-08 21:44:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-08 21:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7476  77 56147 78246269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-08 21:44:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 21:44:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 21:44:56 [DEBUG   ] Finished updating board flags in 1.333 seconds
2012-08-08 21:44:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 21:45:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 21:45:28 [DEBUG   ] Got command INI from MCS: ref #7492
2012-08-08 21:45:28 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2012-08-08 21:45:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI     7492   8 56147 78328645 ABOOTING'
2012-08-08 21:45:48 [INFO    ] -------------------
2012-08-08 21:45:48 [INFO    ]  LWA board status
2012-08-08 21:45:48 [INFO    ] -------------------
2012-08-08 21:45:48 [INFO    ] DP 1: 2 lwa27
2012-08-08 21:45:48 [INFO    ] DP 1: 3 lwa24
2012-08-08 21:45:48 [INFO    ] DP 1: 4 lwa23
2012-08-08 21:45:48 [INFO    ] DP 1: 5 lwa18
2012-08-08 21:45:48 [INFO    ] DP 1: 6 lwa10
2012-08-08 21:45:48 [INFO    ] DP 1: 7 lwa32
2012-08-08 21:45:48 [INFO    ] DP 1: 8 lwa11
2012-08-08 21:45:48 [INFO    ] DP 1: 9 lwa30
2012-08-08 21:45:48 [INFO    ] DP 1: 10 lwa12
2012-08-08 21:45:48 [INFO    ] DP 1: 11 lwa8
2012-08-08 21:45:48 [INFO    ] DP 1: 12 lwa13
2012-08-08 21:45:48 [INFO    ] DP 1: 13 lwa26
2012-08-08 21:45:48 [INFO    ] DP 1: 14 lwa14
2012-08-08 21:45:48 [INFO    ] DP 1: 16 lwa22
2012-08-08 21:45:48 [INFO    ] DP 1: 17 lwa20
2012-08-08 21:45:48 [INFO    ] DP 1: 18 lwa1
2012-08-08 21:45:48 [INFO    ] DP 1: 19 lwa5
2012-08-08 21:45:48 [INFO    ] DP 1: 20 lwa25
2012-08-08 21:45:48 [INFO    ] DP 1: 21 lwa35
2012-08-08 21:45:48 [INFO    ] DP 1: 22 lwa19
2012-08-08 21:45:48 [INFO    ] DP 1: 23 lwa21
2012-08-08 21:45:48 [INFO    ] DP 1: 24 lwa6
2012-08-08 21:45:48 [INFO    ] DP 1: 25 lwa7
2012-08-08 21:45:48 [INFO    ] DP 1: 26 lwa33
2012-08-08 21:45:48 [INFO    ] DP 1: 27 lwa15
2012-08-08 21:45:48 [INFO    ] DP 1: 28 lwa28
2012-08-08 21:45:48 [INFO    ] DP 2: 1 lwa16
2012-08-08 21:45:48 [INFO    ] DP 2: 15 lwa34
2012-08-08 21:45:48 [INFO    ] Total of 28 boards
2012-08-08 21:45:48 [INFO    ] Total of 260 stands
2012-08-08 21:45:48 [INFO    ] -------------------
2012-08-08 21:45:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12867
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12868
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12869
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12870
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12871
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12872
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12873
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12874
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12875
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12876
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12877
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12878
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12879
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12880
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12881
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12882
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12883
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12884
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12885
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12886
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12887
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12888
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12889
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12890
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12891
2012-08-08 21:45:55 [DEBUG   ] 2012-08-08 21:45:55 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 12892
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12867 exited with status 0
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12868 exited with status 0
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12869 exited with status 0
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12870 exited with status 0
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12871 exited with status 0
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12872 exited with status 0
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12873 exited with status 0
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12874 exited with status 0
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12875 exited with status 0
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12876 exited with status 0
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12877 exited with status 0
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12878 exited with status 0
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12879 exited with status 0
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12880 exited with status 0
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12881 exited with status 0
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12882 exited with status 0
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12883 exited with status 0
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12884 exited with status 0
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12885 exited with status 0
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12886 exited with status 0
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12887 exited with status 0
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12888 exited with status 0
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12889 exited with status 0
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12890 exited with status 0
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12891 exited with status 0
2012-08-08 21:46:07 [DEBUG   ] 2012-08-08 21:46:07 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 12892 exited with status 0
2012-08-08 21:46:07 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2012-08-08 21:46:07 [DEBUG   ] spawn_process: at 2012-08-08 21:46:07 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] spawn_process: at 2012-08-08 21:46:08 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] spawn_process: at 2012-08-08 21:46:08 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] spawn_process: at 2012-08-08 21:46:08 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] spawn_process: at 2012-08-08 21:46:08 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] spawn_process: at 2012-08-08 21:46:08 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] spawn_process: at 2012-08-08 21:46:08 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] spawn_process: at 2012-08-08 21:46:08 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] spawn_process: at 2012-08-08 21:46:08 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] spawn_process: at 2012-08-08 21:46:08 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] spawn_process: at 2012-08-08 21:46:08 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] spawn_process: at 2012-08-08 21:46:08 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] spawn_process: at 2012-08-08 21:46:08 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] spawn_process: at 2012-08-08 21:46:08 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] spawn_process: at 2012-08-08 21:46:08 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] spawn_process: at 2012-08-08 21:46:08 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] spawn_process: at 2012-08-08 21:46:08 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] spawn_process: at 2012-08-08 21:46:08 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] spawn_process: at 2012-08-08 21:46:08 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] spawn_process: at 2012-08-08 21:46:08 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] spawn_process: at 2012-08-08 21:46:08 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] spawn_process: at 2012-08-08 21:46:08 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] spawn_process: at 2012-08-08 21:46:08 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] spawn_process: at 2012-08-08 21:46:08 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] spawn_process: at 2012-08-08 21:46:08 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] spawn_process: at 2012-08-08 21:46:08 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2012-08-08 21:46:08 [DEBUG   ] 2012-08-08 21:46:08 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 12919
2012-08-08 21:46:08 [DEBUG   ] 2012-08-08 21:46:08 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 12920
2012-08-08 21:46:13 [DEBUG   ] 2012-08-08 21:46:13 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 12919 exited with status 0
2012-08-08 21:46:13 [DEBUG   ] 2012-08-08 21:46:13 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 12920 exited with status 0
2012-08-08 21:46:13 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2012-08-08 21:46:13 [DEBUG   ] spawn_process: at 2012-08-08 21:46:13 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2012-08-08 21:46:13 [DEBUG   ] spawn_process: at 2012-08-08 21:46:13 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2012-08-08 21:46:13 [INFO    ] Setting Beam 1 xbars
2012-08-08 21:46:13 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2012-08-08 21:46:13 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2012-08-08 21:46:13 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2012-08-08 21:46:13 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2012-08-08 21:46:14 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2012-08-08 21:46:14 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2012-08-08 21:46:14 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2012-08-08 21:46:14 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2012-08-08 21:46:14 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2012-08-08 21:46:14 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2012-08-08 21:46:14 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2012-08-08 21:46:14 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2012-08-08 21:46:14 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2012-08-08 21:46:15 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2012-08-08 21:46:15 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2012-08-08 21:46:15 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2012-08-08 21:46:15 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2012-08-08 21:46:15 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2012-08-08 21:46:15 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2012-08-08 21:46:15 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2012-08-08 21:46:15 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2012-08-08 21:46:15 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2012-08-08 21:46:16 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2012-08-08 21:46:16 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2012-08-08 21:46:16 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2012-08-08 21:46:16 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2012-08-08 21:46:16 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2012-08-08 21:46:16 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2012-08-08 21:46:16 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2012-08-08 21:46:16 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2012-08-08 21:46:16 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2012-08-08 21:46:17 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2012-08-08 21:46:17 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2012-08-08 21:46:17 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2012-08-08 21:46:17 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2012-08-08 21:46:17 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2012-08-08 21:46:17 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2012-08-08 21:46:17 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2012-08-08 21:46:17 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2012-08-08 21:46:17 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2012-08-08 21:46:18 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2012-08-08 21:46:18 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2012-08-08 21:46:18 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2012-08-08 21:46:18 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2012-08-08 21:46:18 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2012-08-08 21:46:18 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2012-08-08 21:46:18 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2012-08-08 21:46:18 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2012-08-08 21:46:18 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2012-08-08 21:46:18 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2012-08-08 21:46:19 [INFO    ] Setting Beam 2 xbars
2012-08-08 21:46:19 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2012-08-08 21:46:19 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2012-08-08 21:46:19 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2012-08-08 21:46:19 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2012-08-08 21:46:19 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2012-08-08 21:46:19 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2012-08-08 21:46:19 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2012-08-08 21:46:19 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2012-08-08 21:46:19 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2012-08-08 21:46:20 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2012-08-08 21:46:20 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2012-08-08 21:46:20 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2012-08-08 21:46:20 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2012-08-08 21:46:20 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2012-08-08 21:46:20 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2012-08-08 21:46:20 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2012-08-08 21:46:20 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2012-08-08 21:46:20 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2012-08-08 21:46:21 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2012-08-08 21:46:21 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2012-08-08 21:46:21 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2012-08-08 21:46:21 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2012-08-08 21:46:21 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2012-08-08 21:46:21 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2012-08-08 21:46:21 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2012-08-08 21:46:21 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2012-08-08 21:46:21 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2012-08-08 21:46:22 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2012-08-08 21:46:22 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2012-08-08 21:46:22 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2012-08-08 21:46:22 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2012-08-08 21:46:22 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2012-08-08 21:46:22 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2012-08-08 21:46:22 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2012-08-08 21:46:22 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2012-08-08 21:46:22 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2012-08-08 21:46:23 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2012-08-08 21:46:23 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2012-08-08 21:46:23 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2012-08-08 21:46:23 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2012-08-08 21:46:23 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2012-08-08 21:46:23 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2012-08-08 21:46:23 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2012-08-08 21:46:23 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2012-08-08 21:46:23 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2012-08-08 21:46:24 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2012-08-08 21:46:24 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2012-08-08 21:46:24 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2012-08-08 21:46:24 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2012-08-08 21:46:24 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2012-08-08 21:46:24 [INFO    ] Setting Beam 3 xbars
2012-08-08 21:46:24 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2012-08-08 21:46:24 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2012-08-08 21:46:24 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2012-08-08 21:46:24 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2012-08-08 21:46:24 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2012-08-08 21:46:25 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2012-08-08 21:46:25 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2012-08-08 21:46:25 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2012-08-08 21:46:25 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2012-08-08 21:46:25 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2012-08-08 21:46:25 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2012-08-08 21:46:25 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2012-08-08 21:46:25 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2012-08-08 21:46:25 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2012-08-08 21:46:26 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2012-08-08 21:46:26 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2012-08-08 21:46:26 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2012-08-08 21:46:26 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2012-08-08 21:46:26 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2012-08-08 21:46:26 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2012-08-08 21:46:26 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2012-08-08 21:46:26 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2012-08-08 21:46:26 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2012-08-08 21:46:27 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2012-08-08 21:46:27 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2012-08-08 21:46:27 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2012-08-08 21:46:27 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2012-08-08 21:46:27 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2012-08-08 21:46:27 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2012-08-08 21:46:27 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2012-08-08 21:46:27 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2012-08-08 21:46:27 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2012-08-08 21:46:28 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2012-08-08 21:46:28 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2012-08-08 21:46:28 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2012-08-08 21:46:28 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2012-08-08 21:46:28 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2012-08-08 21:46:28 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2012-08-08 21:46:28 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2012-08-08 21:46:28 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2012-08-08 21:46:28 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2012-08-08 21:46:29 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2012-08-08 21:46:29 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2012-08-08 21:46:29 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2012-08-08 21:46:29 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2012-08-08 21:46:29 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2012-08-08 21:46:29 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2012-08-08 21:46:29 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2012-08-08 21:46:29 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2012-08-08 21:46:29 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2012-08-08 21:46:29 [INFO    ] Setting Beam 4 xbars
2012-08-08 21:46:29 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2012-08-08 21:46:30 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 21:46:30 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 21:46:30 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 21:46:30 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 21:46:30 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2012-08-08 21:46:30 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2012-08-08 21:46:30 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2012-08-08 21:46:30 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2012-08-08 21:46:30 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2012-08-08 21:46:31 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2012-08-08 21:46:31 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2012-08-08 21:46:31 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2012-08-08 21:46:31 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2012-08-08 21:46:31 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2012-08-08 21:46:31 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2012-08-08 21:46:31 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2012-08-08 21:46:31 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2012-08-08 21:46:31 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2012-08-08 21:46:32 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2012-08-08 21:46:32 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2012-08-08 21:46:32 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2012-08-08 21:46:32 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2012-08-08 21:46:32 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2012-08-08 21:46:32 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2012-08-08 21:46:32 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2012-08-08 21:46:32 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2012-08-08 21:46:32 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2012-08-08 21:46:33 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2012-08-08 21:46:33 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2012-08-08 21:46:33 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2012-08-08 21:46:33 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2012-08-08 21:46:33 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2012-08-08 21:46:33 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2012-08-08 21:46:33 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2012-08-08 21:46:33 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2012-08-08 21:46:33 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2012-08-08 21:46:34 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2012-08-08 21:46:34 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2012-08-08 21:46:34 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2012-08-08 21:46:34 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2012-08-08 21:46:34 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2012-08-08 21:46:34 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2012-08-08 21:46:34 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2012-08-08 21:46:34 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2012-08-08 21:46:34 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2012-08-08 21:46:34 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2012-08-08 21:46:35 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2012-08-08 21:46:35 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2012-08-08 21:46:35 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2012-08-08 21:46:35 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2012-08-08 21:46:35 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2012-08-08 21:46:35 [INFO    ] All xbars set
2012-08-08 21:46:35 [INFO    ] Setting adder chain routing for all beams
2012-08-08 21:46:40 [INFO    ] Setting beam ids
2012-08-08 21:46:50 [INFO    ] Starting beam delay calibration
2012-08-08 21:46:53 [DEBUG   ] Got command RPT from MCS: ref #7493
2012-08-08 21:46:53 [DEBUG   ] summary = BOOTING
2012-08-08 21:46:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7493  15 56147 78413553 ABOOTINGBOOTING'
2012-08-08 21:47:02 [INFO    ] Beam 1 latency is 5732
2012-08-08 21:47:02 [INFO    ] Beam 2 latency is 5780
2012-08-08 21:47:02 [INFO    ] Beam 3 latency is 5765
2012-08-08 21:47:02 [INFO    ] Beam 4 latency is 5720
2012-08-08 21:47:02 [INFO    ] Stop calibration
2012-08-08 21:47:10 [INFO    ] Beam delay calibration successful
2012-08-08 21:47:10 [INFO    ] Calibration passed
2012-08-08 21:47:10 [DEBUG   ] spawn_process: at 2012-08-08 21:47:10 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2012-08-08 21:47:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2012-08-08 21:47:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2012-08-08 21:47:10 [DEBUG   ] spawn_process: at 2012-08-08 21:47:10 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2012-08-08 21:47:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2012-08-08 21:47:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2012-08-08 21:47:10 [DEBUG   ] spawn_process: at 2012-08-08 21:47:10 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2012-08-08 21:47:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2012-08-08 21:47:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2012-08-08 21:47:10 [DEBUG   ] spawn_process: at 2012-08-08 21:47:10 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2012-08-08 21:47:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2012-08-08 21:47:10 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2012-08-08 21:47:11 [INFO    ] Started antennas statistics background thread
2012-08-08 21:47:11 [INFO    ] Started board flags background thread
2012-08-08 21:47:11 [INFO    ] Started BAM background thread
2012-08-08 21:47:12 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 with PID 14511
2012-08-08 21:47:12 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 with PID 14514
2012-08-08 21:47:12 [INFO    ] Finished the INI process in 103.578 s
2012-08-08 21:47:12 [DEBUG   ] Finished updating ant stats in 1.290 seconds
2012-08-08 21:47:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 21:47:12 [DEBUG   ] Finished updating board flags in 0.880 seconds
2012-08-08 21:47:32 [DEBUG   ] Finished updating ant stats in 1.176 seconds
2012-08-08 21:47:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 21:47:55 [DEBUG   ] Got command RPT from MCS: ref #7494
2012-08-08 21:47:55 [DEBUG   ] summary = NORMAL
2012-08-08 21:47:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7494  14 56147 78475997 A NORMALNORMAL'
2012-08-08 21:48:12 [DEBUG   ] Finished updating ant stats in 1.026 seconds
2012-08-08 21:48:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 21:48:12 [DEBUG   ] Finished updating board flags in 0.864 seconds
2012-08-08 21:48:32 [DEBUG   ] Finished updating ant stats in 0.977 seconds
2012-08-08 21:48:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 21:49:06 [DEBUG   ] Got command RPT from MCS: ref #7499
2012-08-08 21:49:06 [DEBUG   ] summary = NORMAL
2012-08-08 21:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7499  14 56147 78546268 A NORMALNORMAL'
2012-08-08 21:49:06 [DEBUG   ] Got command RPT from MCS: ref #7500
2012-08-08 21:49:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 21:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7500  48 56147 78546269 A NORMALSystem calibrated and operating normally'
2012-08-08 21:49:12 [DEBUG   ] Finished updating ant stats in 0.628 seconds
2012-08-08 21:49:12 [DEBUG   ] Finished updating board flags in 0.841 seconds
2012-08-08 21:49:32 [DEBUG   ] Finished updating ant stats in 0.572 seconds
2012-08-08 21:49:52 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 21:50:12 [DEBUG   ] Finished updating ant stats in 0.427 seconds
2012-08-08 21:50:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 21:50:13 [DEBUG   ] Finished updating board flags in 0.845 seconds
2012-08-08 21:50:32 [DEBUG   ] Finished updating ant stats in 0.376 seconds
2012-08-08 21:50:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 21:51:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-08 21:51:13 [DEBUG   ] Finished updating board flags in 0.853 seconds
2012-08-08 21:51:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 21:51:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 21:51:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 21:52:13 [DEBUG   ] Finished updating ant stats in 1.228 seconds
2012-08-08 21:52:13 [DEBUG   ] Finished updating board flags in 1.040 seconds
2012-08-08 21:52:33 [DEBUG   ] Finished updating ant stats in 1.176 seconds
2012-08-08 21:52:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 21:53:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 21:53:13 [DEBUG   ] Finished updating ant stats in 1.029 seconds
2012-08-08 21:53:13 [DEBUG   ] Finished updating board flags in 1.205 seconds
2012-08-08 21:53:33 [DEBUG   ] Finished updating ant stats in 0.972 seconds
2012-08-08 21:53:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 21:54:06 [DEBUG   ] Got command RPT from MCS: ref #7521
2012-08-08 21:54:06 [DEBUG   ] summary = NORMAL
2012-08-08 21:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7521  14 56147 78846269 A NORMALNORMAL'
2012-08-08 21:54:06 [DEBUG   ] Got command RPT from MCS: ref #7522
2012-08-08 21:54:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 21:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7522  48 56147 78846269 A NORMALSystem calibrated and operating normally'
2012-08-08 21:54:13 [DEBUG   ] Finished updating ant stats in 0.823 seconds
2012-08-08 21:54:13 [DEBUG   ] Finished updating board flags in 1.067 seconds
2012-08-08 21:54:33 [DEBUG   ] Finished updating ant stats in 0.780 seconds
2012-08-08 21:54:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 21:55:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 21:55:13 [DEBUG   ] Finished updating ant stats in 0.619 seconds
2012-08-08 21:55:13 [DEBUG   ] Finished updating board flags in 1.051 seconds
2012-08-08 21:55:33 [DEBUG   ] Finished updating ant stats in 0.581 seconds
2012-08-08 21:55:53 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 21:56:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 21:56:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 21:56:13 [DEBUG   ] Finished updating board flags in 1.461 seconds
2012-08-08 21:56:33 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 21:56:53 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 21:57:13 [DEBUG   ] Finished updating ant stats in 0.419 seconds
2012-08-08 21:57:13 [DEBUG   ] Finished updating board flags in 0.906 seconds
2012-08-08 21:57:33 [DEBUG   ] Finished updating ant stats in 0.380 seconds
2012-08-08 21:57:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 21:58:08 [DEBUG   ] Got command DRX from MCS: ref #7538
2012-08-08 21:58:08 [INFO    ] sending drx command to lwa34
2012-08-08 21:58:08 [DEBUG   ] run_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa34', '/lwa/software/drx 5 1 37900000.0 7 8 0']
2012-08-08 21:58:08 [DEBUG   ] drx = exited with status True, code 0x00
2012-08-08 21:58:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     7538   8 56147 79088113 A NORMAL'
2012-08-08 21:58:08 [DEBUG   ] Got command DRX from MCS: ref #7539
2012-08-08 21:58:08 [INFO    ] sending drx command to lwa34
2012-08-08 21:58:08 [DEBUG   ] run_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa34', '/lwa/software/drx 5 2 74030000.0 7 8 0']
2012-08-08 21:58:08 [DEBUG   ] drx = exited with status True, code 0x00
2012-08-08 21:58:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     7539   8 56147 79088117 A NORMAL'
2012-08-08 21:58:08 [DEBUG   ] Got command BAM from MCS: ref #7540
2012-08-08 21:58:08 [INFO    ] Finished processing BAM request
2012-08-08 21:58:08 [DEBUG   ] bam = exited with status True, code 0x00
2012-08-08 21:58:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7540   8 56147 79088121 A NORMAL'
2012-08-08 21:58:08 [DEBUG   ] Got command DRX from MCS: ref #7541
2012-08-08 21:58:08 [INFO    ] sending drx command to lwa34
2012-08-08 21:58:08 [DEBUG   ] run_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 37900000.0 7 8 0']
2012-08-08 21:58:08 [DEBUG   ] drx = exited with status True, code 0x00
2012-08-08 21:58:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     7541   8 56147 79088125 A NORMAL'
2012-08-08 21:58:08 [DEBUG   ] Got command DRX from MCS: ref #7542
2012-08-08 21:58:08 [INFO    ] sending drx command to lwa34
2012-08-08 21:58:08 [DEBUG   ] run_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 74030000.0 7 8 0']
2012-08-08 21:58:08 [DEBUG   ] drx = exited with status True, code 0x00
2012-08-08 21:58:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     7542   8 56147 79088129 A NORMAL'
2012-08-08 21:58:08 [DEBUG   ] Got command BAM from MCS: ref #7543
2012-08-08 21:58:08 [INFO    ] Finished processing BAM request
2012-08-08 21:58:08 [DEBUG   ] bam = exited with status True, code 0x00
2012-08-08 21:58:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7543   8 56147 79088133 A NORMAL'
2012-08-08 21:58:08 [DEBUG   ] Got command DRX from MCS: ref #7544
2012-08-08 21:58:08 [INFO    ] sending drx command to lwa16
2012-08-08 21:58:08 [DEBUG   ] run_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 37900000.0 7 8 0']
2012-08-08 21:58:08 [DEBUG   ] drx = exited with status True, code 0x00
2012-08-08 21:58:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     7544   8 56147 79088149 A NORMAL'
2012-08-08 21:58:08 [DEBUG   ] Got command DRX from MCS: ref #7545
2012-08-08 21:58:08 [INFO    ] sending drx command to lwa16
2012-08-08 21:58:08 [DEBUG   ] run_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 74030000.0 7 8 0']
2012-08-08 21:58:08 [DEBUG   ] drx = exited with status True, code 0x00
2012-08-08 21:58:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     7545   8 56147 79088153 A NORMAL'
2012-08-08 21:58:08 [DEBUG   ] Got command BAM from MCS: ref #7546
2012-08-08 21:58:08 [INFO    ] Finished processing BAM request
2012-08-08 21:58:08 [DEBUG   ] bam = exited with status True, code 0x00
2012-08-08 21:58:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7546   8 56147 79088157 A NORMAL'
2012-08-08 21:58:08 [DEBUG   ] Got command DRX from MCS: ref #7547
2012-08-08 21:58:08 [INFO    ] sending drx command to lwa16
2012-08-08 21:58:08 [DEBUG   ] run_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 1 37900000.0 7 8 0']
2012-08-08 21:58:08 [DEBUG   ] drx = exited with status True, code 0x00
2012-08-08 21:58:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     7547   8 56147 79088161 A NORMAL'
2012-08-08 21:58:08 [DEBUG   ] Got command DRX from MCS: ref #7548
2012-08-08 21:58:08 [INFO    ] sending drx command to lwa16
2012-08-08 21:58:08 [DEBUG   ] run_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 2 74030000.0 7 8 0']
2012-08-08 21:58:08 [DEBUG   ] drx = exited with status True, code 0x00
2012-08-08 21:58:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     7548   8 56147 79088165 A NORMAL'
2012-08-08 21:58:08 [DEBUG   ] Got command BAM from MCS: ref #7549
2012-08-08 21:58:08 [INFO    ] Finished processing BAM request
2012-08-08 21:58:08 [DEBUG   ] bam = exited with status True, code 0x00
2012-08-08 21:58:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     7549   8 56147 79088169 A NORMAL'
2012-08-08 21:58:08 [INFO    ] Finished starting DRX
2012-08-08 21:58:08 [INFO    ] Finished starting DRX
2012-08-08 21:58:08 [INFO    ] Finished starting DRX
2012-08-08 21:58:08 [INFO    ] Finished starting DRX
2012-08-08 21:58:08 [INFO    ] Finished starting DRX
2012-08-08 21:58:08 [INFO    ] Finished starting DRX
2012-08-08 21:58:08 [INFO    ] Finished starting DRX
2012-08-08 21:58:08 [INFO    ] Finished starting DRX
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2012-08-08 21:58:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2012-08-08 21:58:08 [DEBUG   ] spawn_process: at 2012-08-08 21:58:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2012-08-08 21:58:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 21:58:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 21:58:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 21:58:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 21:58:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 21:58:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 21:58:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 4
2012-08-08 21:58:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 21:58:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 21:58:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 21:58:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 21:58:13 [DEBUG   ] Finished updating board flags in 0.876 seconds
2012-08-08 21:58:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 21:58:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 21:58:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 21:59:06 [DEBUG   ] Got command RPT from MCS: ref #7554
2012-08-08 21:59:06 [DEBUG   ] summary = NORMAL
2012-08-08 21:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7554  14 56147 79146277 A NORMALNORMAL'
2012-08-08 21:59:06 [DEBUG   ] Got command RPT from MCS: ref #7555
2012-08-08 21:59:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 21:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7555  48 56147 79146277 A NORMALSystem calibrated and operating normally'
2012-08-08 21:59:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 21:59:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 21:59:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 21:59:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 21:59:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 21:59:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 21:59:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 21:59:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 21:59:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 21:59:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 21:59:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 1
2012-08-08 21:59:13 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 21:59:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 3
2012-08-08 21:59:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 21:59:13 [DEBUG   ] Finished updating board flags in 0.905 seconds
2012-08-08 21:59:14 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2012-08-08 21:59:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 21:59:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:00:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:00:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 22:00:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:00:13 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:00:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 22:00:13 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 22:00:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:00:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:00:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 22:00:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 22:00:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:00:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 22:00:13 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:00:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 22:00:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:00:13 [DEBUG   ] Finished updating board flags in 0.903 seconds
2012-08-08 22:00:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 22:00:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-08 22:00:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 22:01:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:01:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:01:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 22:01:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:01:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:01:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 22:01:13 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:01:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 22:01:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 22:01:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:01:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:01:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 22:01:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-08 22:01:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:01:13 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2012-08-08 22:01:13 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:01:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 2
2012-08-08 22:01:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:01:13 [DEBUG   ] Finished updating board flags in 1.084 seconds
2012-08-08 22:01:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 22:01:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 22:01:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 22:02:13 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-08 22:02:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 22:02:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 22:02:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:02:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:02:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 22:02:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 22:02:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:02:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:02:13 [WARNING ] MonitorFlags: Temperature 83.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:02:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 22:02:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 22:02:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:02:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:02:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 22:02:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:02:14 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-08 22:02:14 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:02:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2012-08-08 22:02:14 [DEBUG   ] Finished updating board flags in 1.539 seconds
2012-08-08 22:02:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 22:02:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 22:03:13 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa27, chip 2
2012-08-08 22:03:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:03:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:03:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:03:13 [WARNING ] MonitorFlags: Temperature 84.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:03:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 22:03:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:03:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:03:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:03:13 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2012-08-08 22:03:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 22:03:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 22:03:13 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:03:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 22:03:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:03:14 [DEBUG   ] Finished updating board flags in 0.926 seconds
2012-08-08 22:03:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 22:03:34 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 22:03:54 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 22:04:06 [DEBUG   ] Got command RPT from MCS: ref #7571
2012-08-08 22:04:06 [DEBUG   ] summary = WARNING
2012-08-08 22:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7571  15 56147 79446269 AWARNINGWARNING'
2012-08-08 22:04:06 [DEBUG   ] Got command RPT from MCS: ref #7572
2012-08-08 22:04:06 [DEBUG   ] info = BOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD23_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 4 boards
2012-08-08 22:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7572 127 56147 79446269 AWARNINGBOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD23_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 4 boards'
2012-08-08 22:04:13 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa27, chip 2
2012-08-08 22:04:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:04:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 2
2012-08-08 22:04:13 [WARNING ] MonitorFlags: Temperature 85.10 > 80 on hostname lwa30, chip 2
2012-08-08 22:04:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 2
2012-08-08 22:04:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 22:04:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 1
2012-08-08 22:04:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 3
2012-08-08 22:04:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 22:04:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2012-08-08 22:04:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 22:04:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:04:13 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2012-08-08 22:04:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 22:04:14 [WARNING ] MonitorFlags: Temperature 83.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:04:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 5
2012-08-08 22:04:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:04:14 [DEBUG   ] Finished updating board flags in 0.940 seconds
2012-08-08 22:04:14 [DEBUG   ] Finished updating ant stats in 0.407 seconds
2012-08-08 22:04:34 [DEBUG   ] Finished updating ant stats in 0.392 seconds
2012-08-08 22:04:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 22:05:13 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa27, chip 2
2012-08-08 22:05:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:05:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:05:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:05:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 22:05:13 [WARNING ] MonitorFlags: Temperature 85.10 > 80 on hostname lwa30, chip 2
2012-08-08 22:05:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2012-08-08 22:05:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:05:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:05:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 3
2012-08-08 22:05:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 22:05:14 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2012-08-08 22:05:14 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:05:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2012-08-08 22:05:14 [DEBUG   ] Finished updating board flags in 1.071 seconds
2012-08-08 22:05:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 22:05:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 22:05:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 22:06:13 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa27, chip 2
2012-08-08 22:06:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:06:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 2
2012-08-08 22:06:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:06:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 22:06:13 [WARNING ] MonitorFlags: Temperature 85.10 > 80 on hostname lwa30, chip 2
2012-08-08 22:06:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 22:06:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 22:06:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 4
2012-08-08 22:06:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 22:06:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 22:06:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2012-08-08 22:06:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:06:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:06:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 22:06:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:06:14 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2012-08-08 22:06:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 22:06:14 [WARNING ] MonitorFlags: Temperature 83.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:06:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 3
2012-08-08 22:06:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2012-08-08 22:06:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:06:14 [DEBUG   ] Finished updating board flags in 1.029 seconds
2012-08-08 22:06:15 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 22:06:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:06:55 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2012-08-08 22:07:13 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa27, chip 2
2012-08-08 22:07:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:07:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 22:07:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:07:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:07:13 [WARNING ] MonitorFlags: Temperature 85.10 > 80 on hostname lwa30, chip 2
2012-08-08 22:07:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 22:07:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 22:07:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:07:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:07:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:07:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 22:07:14 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2012-08-08 22:07:14 [WARNING ] MonitorFlags: Temperature 83.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:07:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2012-08-08 22:07:14 [DEBUG   ] Finished updating board flags in 1.006 seconds
2012-08-08 22:07:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 22:07:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 22:07:55 [DEBUG   ] Finished updating ant stats in 0.592 seconds
2012-08-08 22:08:13 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa27, chip 2
2012-08-08 22:08:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 22:08:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:08:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 22:08:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2012-08-08 22:08:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:08:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:08:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:08:13 [WARNING ] MonitorFlags: Temperature 84.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:08:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2012-08-08 22:08:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:08:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:08:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:08:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 22:08:14 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2012-08-08 22:08:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 22:08:14 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:08:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:08:14 [DEBUG   ] Finished updating board flags in 0.862 seconds
2012-08-08 22:08:15 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 22:08:35 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 22:08:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 22:09:06 [DEBUG   ] Got command RPT from MCS: ref #7588
2012-08-08 22:09:06 [DEBUG   ] summary = WARNING
2012-08-08 22:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7588  15 56147 79746277 AWARNINGWARNING'
2012-08-08 22:09:06 [DEBUG   ] Got command RPT from MCS: ref #7589
2012-08-08 22:09:06 [DEBUG   ] info = BOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD23_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 4 boards
2012-08-08 22:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7589 127 56147 79746277 AWARNINGBOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD23_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 4 boards'
2012-08-08 22:09:13 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa27, chip 2
2012-08-08 22:09:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 22:09:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 22:09:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:09:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:09:13 [WARNING ] MonitorFlags: Temperature 84.20 > 80 on hostname lwa30, chip 2
2012-08-08 22:09:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 22:09:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2012-08-08 22:09:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 22:09:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 22:09:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 22:09:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:09:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:09:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 22:09:14 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2012-08-08 22:09:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 22:09:14 [WARNING ] MonitorFlags: Temperature 83.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:09:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 5
2012-08-08 22:09:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:09:14 [DEBUG   ] Finished updating board flags in 0.833 seconds
2012-08-08 22:09:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 22:09:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 22:09:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 22:10:13 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa27, chip 2
2012-08-08 22:10:13 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 22:10:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:10:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:10:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 22:10:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:10:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:10:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:10:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 22:10:13 [WARNING ] MonitorFlags: Temperature 84.20 > 80 on hostname lwa30, chip 2
2012-08-08 22:10:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-08 22:10:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 3
2012-08-08 22:10:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 22:10:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:10:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 22:10:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:10:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 22:10:14 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-08 22:10:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 22:10:14 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:10:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 3
2012-08-08 22:10:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2012-08-08 22:10:14 [DEBUG   ] Finished updating board flags in 0.836 seconds
2012-08-08 22:10:16 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2012-08-08 22:10:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:10:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:11:13 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa27, chip 2
2012-08-08 22:11:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 22:11:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:11:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:11:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 22:11:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:11:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:11:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:11:13 [WARNING ] MonitorFlags: Temperature 84.20 > 80 on hostname lwa30, chip 2
2012-08-08 22:11:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 22:11:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 22:11:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 22:11:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 22:11:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:11:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:11:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 22:11:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:11:14 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-08 22:11:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 22:11:14 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:11:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 3
2012-08-08 22:11:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2012-08-08 22:11:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:11:14 [DEBUG   ] Finished updating board flags in 0.834 seconds
2012-08-08 22:11:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 22:11:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:11:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 22:12:13 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa27, chip 2
2012-08-08 22:12:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:12:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:12:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 22:12:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:12:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:12:13 [WARNING ] MonitorFlags: Temperature 83.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:12:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 22:12:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:12:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:12:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 22:12:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:12:14 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2012-08-08 22:12:14 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:12:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 22:12:14 [DEBUG   ] Finished updating board flags in 0.842 seconds
2012-08-08 22:12:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 22:12:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 22:12:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 22:13:13 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa27, chip 2
2012-08-08 22:13:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:13:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:13:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 22:13:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:13:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:13:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:13:13 [WARNING ] MonitorFlags: Temperature 83.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:13:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 22:13:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 22:13:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:13:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:13:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 22:13:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:13:14 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2012-08-08 22:13:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 22:13:14 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:13:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2012-08-08 22:13:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:13:14 [DEBUG   ] Finished updating board flags in 0.842 seconds
2012-08-08 22:13:16 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 22:13:36 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 22:13:57 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 22:14:06 [DEBUG   ] Got command RPT from MCS: ref #7605
2012-08-08 22:14:06 [DEBUG   ] summary = WARNING
2012-08-08 22:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7605  15 56147 80046269 AWARNINGWARNING'
2012-08-08 22:14:06 [DEBUG   ] Got command RPT from MCS: ref #7606
2012-08-08 22:14:06 [DEBUG   ] info = BOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD23_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 4 boards
2012-08-08 22:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7606 127 56147 80046269 AWARNINGBOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD23_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 4 boards'
2012-08-08 22:14:13 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa27, chip 2
2012-08-08 22:14:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:14:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 22:14:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:14:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:14:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 22:14:13 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa30, chip 2
2012-08-08 22:14:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 22:14:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 22:14:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 22:14:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 22:14:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:14:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:14:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 22:14:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:14:14 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2012-08-08 22:14:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 22:14:14 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:14:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:14:14 [DEBUG   ] Finished updating board flags in 0.842 seconds
2012-08-08 22:14:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 22:14:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 22:14:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 22:15:13 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-08 22:15:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:15:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:15:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:15:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:15:14 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa30, chip 2
2012-08-08 22:15:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 5
2012-08-08 22:15:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 22:15:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 22:15:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 22:15:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:15:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:15:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 22:15:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:15:14 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2012-08-08 22:15:14 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:15:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 2
2012-08-08 22:15:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 22:15:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:15:14 [DEBUG   ] Finished updating board flags in 0.844 seconds
2012-08-08 22:15:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 22:15:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 22:15:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 22:16:13 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-08 22:16:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 22:16:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 22:16:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:16:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:16:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 22:16:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:16:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:16:14 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:16:14 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 22:16:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 22:16:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 22:16:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 5
2012-08-08 22:16:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 22:16:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:16:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-08 22:16:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:16:14 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2012-08-08 22:16:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 22:16:14 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:16:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 22:16:14 [DEBUG   ] Finished updating board flags in 0.871 seconds
2012-08-08 22:16:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 22:16:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 22:16:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 22:17:13 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-08 22:17:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 22:17:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:17:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 22:17:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:17:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:17:14 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:17:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 22:17:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:17:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:17:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 22:17:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-08 22:17:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:17:14 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2012-08-08 22:17:14 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:17:14 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 22:17:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:17:14 [DEBUG   ] Finished updating board flags in 1.111 seconds
2012-08-08 22:17:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 22:17:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 22:17:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:18:14 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-08 22:18:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 22:18:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:18:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 22:18:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:18:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:18:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:18:14 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:18:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 22:18:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 22:18:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 22:18:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 22:18:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:18:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:18:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:18:14 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2012-08-08 22:18:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 22:18:14 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:18:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 22:18:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:18:14 [DEBUG   ] Finished updating board flags in 0.970 seconds
2012-08-08 22:18:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 22:18:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 22:18:57 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 22:19:06 [DEBUG   ] Got command RPT from MCS: ref #7622
2012-08-08 22:19:06 [DEBUG   ] summary = WARNING
2012-08-08 22:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7622  15 56147 80346277 AWARNINGWARNING'
2012-08-08 22:19:06 [DEBUG   ] Got command RPT from MCS: ref #7623
2012-08-08 22:19:06 [DEBUG   ] info = BOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD23_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 4 boards
2012-08-08 22:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7623 127 56147 80346277 AWARNINGBOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD23_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 4 boards'
2012-08-08 22:19:14 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-08 22:19:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 22:19:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 22:19:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:19:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:19:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:19:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 22:19:14 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:19:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 22:19:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:19:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:19:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:19:14 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2012-08-08 22:19:15 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:19:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 22:19:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2012-08-08 22:19:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:19:15 [DEBUG   ] Finished updating board flags in 0.954 seconds
2012-08-08 22:19:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 22:19:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 22:19:57 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 22:20:14 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 22:20:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2012-08-08 22:20:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:20:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:20:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:20:14 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:20:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 22:20:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 22:20:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 22:20:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:20:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 22:20:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 22:20:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 22:20:15 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:20:15 [DEBUG   ] Finished updating board flags in 0.954 seconds
2012-08-08 22:20:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 22:20:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 22:20:57 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 22:21:14 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 22:21:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:21:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 22:21:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 22:21:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:21:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:21:14 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 22:21:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 22:21:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 22:21:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:21:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:21:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 22:21:15 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:21:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 3
2012-08-08 22:21:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:21:15 [DEBUG   ] Finished updating board flags in 1.037 seconds
2012-08-08 22:21:17 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2012-08-08 22:21:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 22:21:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 22:22:14 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 22:22:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:22:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 22:22:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 22:22:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:22:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:22:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:22:14 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 22:22:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2012-08-08 22:22:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 22:22:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 22:22:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 22:22:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 22:22:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:22:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:22:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 22:22:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 22:22:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 22:22:15 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:22:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 2
2012-08-08 22:22:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:22:15 [DEBUG   ] Finished updating board flags in 0.859 seconds
2012-08-08 22:22:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 22:22:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 22:22:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 22:23:14 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 22:23:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:23:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:23:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:23:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 22:23:14 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 22:23:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:23:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:23:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:23:15 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:23:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 3
2012-08-08 22:23:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:23:15 [DEBUG   ] Finished updating board flags in 0.842 seconds
2012-08-08 22:23:17 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 22:23:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-08 22:23:57 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 22:24:06 [DEBUG   ] Got command RPT from MCS: ref #7639
2012-08-08 22:24:06 [DEBUG   ] summary = WARNING
2012-08-08 22:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7639  15 56147 80646273 AWARNINGWARNING'
2012-08-08 22:24:06 [DEBUG   ] Got command RPT from MCS: ref #7640
2012-08-08 22:24:06 [DEBUG   ] info = BOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards
2012-08-08 22:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7640 110 56147 80646273 AWARNINGBOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards'
2012-08-08 22:24:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:24:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 22:24:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 22:24:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:24:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:24:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:24:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 22:24:14 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:24:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 22:24:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 22:24:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 22:24:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:24:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:24:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:24:15 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:24:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:24:15 [DEBUG   ] Finished updating board flags in 0.844 seconds
2012-08-08 22:24:17 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 22:24:37 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 22:24:57 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 22:25:14 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 22:25:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 22:25:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 22:25:14 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:25:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 22:25:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 22:25:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 22:25:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:25:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:25:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:25:15 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:25:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:25:15 [DEBUG   ] Finished updating board flags in 0.863 seconds
2012-08-08 22:25:17 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 22:25:37 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-08 22:25:58 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 22:26:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:26:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:26:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:26:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:26:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:26:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 22:26:14 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:26:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 22:26:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 22:26:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 22:26:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:26:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:26:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:26:15 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:26:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:26:15 [DEBUG   ] Finished updating board flags in 0.863 seconds
2012-08-08 22:26:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 22:26:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 22:26:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 22:27:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 22:27:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:27:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:27:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:27:15 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:27:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 22:27:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 22:27:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 22:27:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:27:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:27:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:27:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 22:27:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 22:27:15 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:27:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:27:15 [DEBUG   ] Finished updating board flags in 0.955 seconds
2012-08-08 22:27:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 22:27:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 22:27:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 22:28:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:28:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 22:28:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:28:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:28:15 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:28:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:28:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:28:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:28:15 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:28:15 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 22:28:15 [DEBUG   ] Finished updating board flags in 1.120 seconds
2012-08-08 22:28:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 22:28:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 22:28:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 22:29:06 [DEBUG   ] Got command RPT from MCS: ref #7656
2012-08-08 22:29:06 [DEBUG   ] summary = NORMAL
2012-08-08 22:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7656  14 56147 80946273 A NORMALNORMAL'
2012-08-08 22:29:06 [DEBUG   ] Got command RPT from MCS: ref #7657
2012-08-08 22:29:06 [DEBUG   ] info = Warning condition cleared, system operating normally
2012-08-08 22:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7657  60 56147 80946273 A NORMALWarning condition cleared, system operating normally'
2012-08-08 22:29:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:29:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:29:15 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:29:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 22:29:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 22:29:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-08 22:29:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:29:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 22:29:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:29:15 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:29:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 22:29:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 4
2012-08-08 22:29:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:29:15 [DEBUG   ] Finished updating board flags in 0.941 seconds
2012-08-08 22:29:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 22:29:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 22:29:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 22:30:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:30:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:30:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:30:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:30:15 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:30:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 22:30:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 22:30:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 22:30:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2012-08-08 22:30:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:30:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:30:15 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:30:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 22:30:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:30:16 [DEBUG   ] Finished updating board flags in 0.926 seconds
2012-08-08 22:30:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 22:30:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 22:30:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 22:31:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:31:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-08 22:31:15 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:31:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 22:31:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 22:31:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:31:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:31:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:31:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 1
2012-08-08 22:31:16 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:31:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:31:16 [DEBUG   ] Finished updating board flags in 0.934 seconds
2012-08-08 22:31:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 22:31:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 22:31:58 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 22:32:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:32:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:32:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:32:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 4
2012-08-08 22:32:15 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:32:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 22:32:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 22:32:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 22:32:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa34, chip 1
2012-08-08 22:32:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:32:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:32:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:32:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-08 22:32:16 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:32:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-08 22:32:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 22:32:16 [DEBUG   ] Finished updating board flags in 1.058 seconds
2012-08-08 22:32:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 22:32:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 22:32:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 22:33:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 22:33:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:33:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-08 22:33:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:33:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:33:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:33:15 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:33:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 22:33:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 22:33:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 22:33:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa34, chip 1
2012-08-08 22:33:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-08 22:33:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:33:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:33:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 22:33:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 5
2012-08-08 22:33:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:33:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 22:33:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 22:33:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 1
2012-08-08 22:33:16 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:33:16 [DEBUG   ] Finished updating board flags in 0.921 seconds
2012-08-08 22:33:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 22:33:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 22:33:58 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 22:34:06 [DEBUG   ] Got command RPT from MCS: ref #7673
2012-08-08 22:34:06 [DEBUG   ] summary = NORMAL
2012-08-08 22:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7673  14 56147 81246276 A NORMALNORMAL'
2012-08-08 22:34:06 [DEBUG   ] Got command RPT from MCS: ref #7674
2012-08-08 22:34:06 [DEBUG   ] info = Warning condition cleared, system operating normally
2012-08-08 22:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7674  60 56147 81246277 A NORMALWarning condition cleared, system operating normally'
2012-08-08 22:34:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:34:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:34:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:34:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:34:15 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 22:34:15 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 22:34:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 22:34:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:34:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:34:16 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:34:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 22:34:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:34:16 [DEBUG   ] Finished updating board flags in 0.897 seconds
2012-08-08 22:34:18 [DEBUG   ] Finished updating ant stats in 1.101 seconds
2012-08-08 22:34:38 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 22:34:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 22:35:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:35:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:35:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 22:35:15 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:35:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 22:35:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 22:35:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 22:35:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 2
2012-08-08 22:35:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:35:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:35:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 22:35:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:35:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 22:35:16 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:35:16 [DEBUG   ] Finished updating board flags in 0.911 seconds
2012-08-08 22:35:18 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2012-08-08 22:35:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:35:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:36:15 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 22:36:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:36:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:36:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:36:16 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:36:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 22:36:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 22:36:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 22:36:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:36:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:36:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 22:36:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:36:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 22:36:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 22:36:16 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:36:16 [DEBUG   ] Finished updating board flags in 0.898 seconds
2012-08-08 22:36:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:36:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:36:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:37:15 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 22:37:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 22:37:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 22:37:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:37:16 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:37:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 22:37:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 22:37:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:37:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:37:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 22:37:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:37:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 22:37:16 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:37:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 22:37:16 [DEBUG   ] Finished updating board flags in 0.901 seconds
2012-08-08 22:37:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:37:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:37:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:38:16 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 22:38:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:38:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:38:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:38:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 22:38:16 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:38:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 22:38:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 22:38:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 22:38:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 2
2012-08-08 22:38:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:38:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:38:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 22:38:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 22:38:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 22:38:16 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:38:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2012-08-08 22:38:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:38:16 [DEBUG   ] Finished updating board flags in 1.037 seconds
2012-08-08 22:38:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:38:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:38:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:39:06 [DEBUG   ] Got command RPT from MCS: ref #7690
2012-08-08 22:39:06 [DEBUG   ] summary = WARNING
2012-08-08 22:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7690  15 56147 81546285 AWARNINGWARNING'
2012-08-08 22:39:06 [DEBUG   ] Got command RPT from MCS: ref #7691
2012-08-08 22:39:06 [DEBUG   ] info = BOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards
2012-08-08 22:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7691 110 56147 81546285 AWARNINGBOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards'
2012-08-08 22:39:16 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 22:39:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:39:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:39:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:39:16 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:39:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 22:39:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 22:39:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:39:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:39:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 22:39:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:39:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 22:39:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 22:39:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 22:39:16 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:39:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 22:39:16 [DEBUG   ] Finished updating board flags in 0.924 seconds
2012-08-08 22:39:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:39:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-08 22:39:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:40:16 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 22:40:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:40:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:40:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:40:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:40:16 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:40:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 22:40:16 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 22:40:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 22:40:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 22:40:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2012-08-08 22:40:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:40:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:40:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 22:40:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:40:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 22:40:16 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:40:16 [DEBUG   ] Finished updating board flags in 0.883 seconds
2012-08-08 22:40:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:40:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:40:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:41:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:41:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:41:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 22:41:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 22:41:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:41:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:41:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 22:41:16 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 22:41:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 22:41:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 22:41:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 22:41:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:41:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:41:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:41:17 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:41:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 22:41:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 22:41:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:41:17 [DEBUG   ] Finished updating board flags in 0.920 seconds
2012-08-08 22:41:18 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2012-08-08 22:41:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 22:41:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 22:42:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:42:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 22:42:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:42:16 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 22:42:16 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 22:42:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:42:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:42:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 22:42:17 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:42:17 [DEBUG   ] Finished updating board flags in 1.115 seconds
2012-08-08 22:42:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 22:42:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 22:42:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 22:43:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 22:43:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:43:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:43:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:43:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 22:43:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:43:16 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 22:43:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 22:43:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 22:43:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 22:43:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:43:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:43:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 22:43:17 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:43:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 22:43:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:43:17 [DEBUG   ] Finished updating board flags in 0.894 seconds
2012-08-08 22:43:18 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2012-08-08 22:43:38 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 22:43:58 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 22:44:06 [DEBUG   ] Got command RPT from MCS: ref #7707
2012-08-08 22:44:06 [DEBUG   ] summary = NORMAL
2012-08-08 22:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7707  14 56147 81846284 A NORMALNORMAL'
2012-08-08 22:44:06 [DEBUG   ] Got command RPT from MCS: ref #7708
2012-08-08 22:44:06 [DEBUG   ] info = Warning condition cleared, system operating normally
2012-08-08 22:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7708  60 56147 81846285 A NORMALWarning condition cleared, system operating normally'
2012-08-08 22:44:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:44:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:44:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:44:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:44:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 22:44:16 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:44:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 22:44:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 22:44:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 22:44:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 22:44:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:44:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:44:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:44:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 22:44:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 5
2012-08-08 22:44:17 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:44:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 4
2012-08-08 22:44:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:44:17 [DEBUG   ] Finished updating board flags in 0.835 seconds
2012-08-08 22:44:18 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2012-08-08 22:44:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 22:44:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 22:45:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:45:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:45:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 22:45:16 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:45:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 22:45:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 22:45:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 22:45:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:45:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:45:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:45:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 22:45:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 22:45:17 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:45:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2012-08-08 22:45:17 [DEBUG   ] Finished updating board flags in 0.837 seconds
2012-08-08 22:45:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 22:45:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 22:45:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 22:46:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:46:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 22:46:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:46:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:46:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:46:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 22:46:16 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-08 22:46:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 22:46:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 22:46:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 22:46:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:46:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:46:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:46:17 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:46:17 [DEBUG   ] Finished updating board flags in 0.863 seconds
2012-08-08 22:46:19 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2012-08-08 22:46:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 22:46:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 22:47:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:47:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 22:47:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:47:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:47:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:47:16 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-08 22:47:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 22:47:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 22:47:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:47:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:47:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:47:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 22:47:17 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:47:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 22:47:17 [DEBUG   ] Finished updating board flags in 0.863 seconds
2012-08-08 22:47:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 22:47:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 22:47:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 22:48:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:48:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:48:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:48:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:48:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 22:48:16 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:48:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 22:48:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 22:48:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:48:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:48:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 22:48:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:48:17 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:48:17 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 22:48:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 22:48:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:48:17 [DEBUG   ] Finished updating board flags in 0.864 seconds
2012-08-08 22:48:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 22:48:39 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2012-08-08 22:48:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:49:06 [DEBUG   ] Got command RPT from MCS: ref #7724
2012-08-08 22:49:06 [DEBUG   ] summary = NORMAL
2012-08-08 22:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7724  14 56147 82146281 A NORMALNORMAL'
2012-08-08 22:49:06 [DEBUG   ] Got command RPT from MCS: ref #7725
2012-08-08 22:49:06 [DEBUG   ] info = Warning condition cleared, system operating normally
2012-08-08 22:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7725  60 56147 82146281 A NORMALWarning condition cleared, system operating normally'
2012-08-08 22:49:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:49:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 22:49:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:49:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:49:17 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:49:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2012-08-08 22:49:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 22:49:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 22:49:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 22:49:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:49:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:49:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:49:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 22:49:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 22:49:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 1
2012-08-08 22:49:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 22:49:17 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:49:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 4
2012-08-08 22:49:17 [DEBUG   ] Finished updating board flags in 0.864 seconds
2012-08-08 22:49:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:49:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:49:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 22:50:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:50:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:50:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 22:50:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 22:50:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:50:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:50:17 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 22:50:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 22:50:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2012-08-08 22:50:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 22:50:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 22:50:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:50:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:50:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:50:17 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:50:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 22:50:17 [DEBUG   ] Finished updating board flags in 0.871 seconds
2012-08-08 22:50:19 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2012-08-08 22:50:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 22:50:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 22:51:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:51:17 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:51:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 22:51:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 22:51:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 22:51:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-08 22:51:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:51:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:51:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 22:51:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:51:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 22:51:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 22:51:17 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:51:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 2
2012-08-08 22:51:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 4
2012-08-08 22:51:17 [DEBUG   ] Finished updating board flags in 1.054 seconds
2012-08-08 22:51:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 22:51:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 22:51:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 22:52:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 22:52:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 22:52:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 22:52:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:52:17 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:52:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 22:52:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2012-08-08 22:52:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:52:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:52:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:52:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 22:52:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 22:52:17 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:52:17 [DEBUG   ] Finished updating board flags in 0.960 seconds
2012-08-08 22:52:19 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2012-08-08 22:52:39 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 22:52:59 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 22:53:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:53:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2012-08-08 22:53:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 22:53:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-08 22:53:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:53:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:53:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:53:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 22:53:17 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:53:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-08 22:53:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 22:53:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 22:53:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 22:53:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:53:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:53:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:53:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 22:53:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 22:53:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 22:53:17 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:53:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 22:53:17 [DEBUG   ] Finished updating board flags in 0.841 seconds
2012-08-08 22:53:19 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 22:53:39 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 22:53:59 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 22:54:06 [DEBUG   ] Got command RPT from MCS: ref #7741
2012-08-08 22:54:06 [DEBUG   ] summary = NORMAL
2012-08-08 22:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7741  14 56147 82446285 A NORMALNORMAL'
2012-08-08 22:54:06 [DEBUG   ] Got command RPT from MCS: ref #7742
2012-08-08 22:54:06 [DEBUG   ] info = Warning condition cleared, system operating normally
2012-08-08 22:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7742  60 56147 82446285 A NORMALWarning condition cleared, system operating normally'
2012-08-08 22:54:17 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 22:54:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 22:54:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:54:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 22:54:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:54:17 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 22:54:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 22:54:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:54:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:54:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:54:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 1
2012-08-08 22:54:18 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:54:18 [DEBUG   ] Finished updating board flags in 0.933 seconds
2012-08-08 22:54:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 22:54:39 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 22:54:59 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 22:55:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:55:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 22:55:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:55:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:55:17 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 22:55:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 22:55:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:55:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:55:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 22:55:18 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 22:55:18 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 22:55:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:55:18 [DEBUG   ] Finished updating board flags in 1.138 seconds
2012-08-08 22:55:19 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 22:55:39 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 22:55:59 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 22:56:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:56:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 22:56:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 22:56:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:56:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:56:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:56:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 22:56:17 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 22:56:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 22:56:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 22:56:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 22:56:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 22:56:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:56:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:56:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:56:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 22:56:18 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:56:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 22:56:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2012-08-08 22:56:18 [DEBUG   ] Finished updating board flags in 1.037 seconds
2012-08-08 22:56:19 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 22:56:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 22:56:59 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 22:57:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 22:57:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 22:57:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 22:57:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-08 22:57:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:57:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:57:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:57:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 22:57:17 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 22:57:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 22:57:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 22:57:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 22:57:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2012-08-08 22:57:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:57:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:57:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:57:18 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:57:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 22:57:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:57:18 [DEBUG   ] Finished updating board flags in 0.899 seconds
2012-08-08 22:57:19 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 22:57:39 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 22:57:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 22:58:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:58:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 22:58:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 22:58:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:58:17 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 22:58:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 22:58:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 22:58:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 22:58:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-08 22:58:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:58:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:58:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 5
2012-08-08 22:58:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:58:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 22:58:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 22:58:18 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:58:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 22:58:18 [DEBUG   ] Finished updating board flags in 0.880 seconds
2012-08-08 22:58:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 22:58:39 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 22:58:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 22:59:06 [DEBUG   ] Got command RPT from MCS: ref #7758
2012-08-08 22:59:06 [DEBUG   ] summary = NORMAL
2012-08-08 22:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7758  14 56147 82746288 A NORMALNORMAL'
2012-08-08 22:59:06 [DEBUG   ] Got command RPT from MCS: ref #7759
2012-08-08 22:59:06 [DEBUG   ] info = Warning condition cleared, system operating normally
2012-08-08 22:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7759  60 56147 82746289 A NORMALWarning condition cleared, system operating normally'
2012-08-08 22:59:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 22:59:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 22:59:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 22:59:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 22:59:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 22:59:17 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 22:59:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 22:59:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2012-08-08 22:59:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 22:59:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 22:59:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-08 22:59:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2012-08-08 22:59:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 22:59:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 22:59:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 22:59:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 22:59:18 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 22:59:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 2
2012-08-08 22:59:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 22:59:18 [DEBUG   ] Finished updating board flags in 0.884 seconds
2012-08-08 22:59:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 22:59:39 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 22:59:59 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-08 23:00:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:00:17 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 23:00:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 23:00:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 23:00:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:00:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:00:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:00:18 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 23:00:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:00:18 [DEBUG   ] Finished updating board flags in 0.883 seconds
2012-08-08 23:00:19 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2012-08-08 23:00:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 23:01:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:01:17 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 23:01:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 23:01:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:01:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 23:01:18 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 23:01:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 23:01:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 23:01:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:01:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:01:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:01:18 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 23:01:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 23:01:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:01:18 [DEBUG   ] Finished updating board flags in 0.882 seconds
2012-08-08 23:01:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:01:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:02:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:02:17 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 23:02:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:02:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:02:18 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa30, chip 2
2012-08-08 23:02:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 23:02:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 23:02:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:02:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:02:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 23:02:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:02:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 23:02:18 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 23:02:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 4
2012-08-08 23:02:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:02:18 [DEBUG   ] Finished updating board flags in 1.135 seconds
2012-08-08 23:02:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 23:02:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 23:03:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:03:18 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 23:03:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 23:03:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:03:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 23:03:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:03:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:03:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 23:03:18 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa30, chip 2
2012-08-08 23:03:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 23:03:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 23:03:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-08 23:03:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:03:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:03:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:03:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 1
2012-08-08 23:03:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 23:03:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 23:03:18 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 23:03:18 [DEBUG   ] Finished updating board flags in 0.913 seconds
2012-08-08 23:03:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:03:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 23:04:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:04:06 [DEBUG   ] Got command RPT from MCS: ref #7775
2012-08-08 23:04:06 [DEBUG   ] summary = WARNING
2012-08-08 23:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7775  15 56147 83046285 AWARNINGWARNING'
2012-08-08 23:04:06 [DEBUG   ] Got command RPT from MCS: ref #7776
2012-08-08 23:04:06 [DEBUG   ] info = BOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards
2012-08-08 23:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7776 110 56147 83046285 AWARNINGBOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards'
2012-08-08 23:04:18 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 23:04:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 23:04:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 23:04:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:04:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 23:04:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:04:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:04:18 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 23:04:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 23:04:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 23:04:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 23:04:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2012-08-08 23:04:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:04:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:04:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 23:04:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-08 23:04:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 23:04:18 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 23:04:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 23:04:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:04:19 [DEBUG   ] Finished updating board flags in 0.916 seconds
2012-08-08 23:04:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:04:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:05:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-08 23:05:18 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 23:05:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 23:05:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:05:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 23:05:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 23:05:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 23:05:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:05:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:05:18 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 23:05:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 23:05:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 23:05:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 23:05:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:05:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:05:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 23:05:19 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 23:05:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 23:05:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 23:05:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:05:19 [DEBUG   ] Finished updating board flags in 0.935 seconds
2012-08-08 23:05:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:05:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:06:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:06:18 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 23:06:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 23:06:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:06:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 23:06:18 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 23:06:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 23:06:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 23:06:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 23:06:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 23:06:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:06:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:06:19 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 23:06:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 23:06:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:06:19 [DEBUG   ] Finished updating board flags in 1.103 seconds
2012-08-08 23:06:20 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2012-08-08 23:06:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 23:07:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 23:07:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 23:07:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 23:07:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:07:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 23:07:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 23:07:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:07:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:07:18 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 23:07:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 23:07:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:07:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:07:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 23:07:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:07:19 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 23:07:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 23:07:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:07:19 [DEBUG   ] Finished updating board flags in 0.879 seconds
2012-08-08 23:07:20 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-08 23:07:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 23:08:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 23:08:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:08:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:08:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:08:18 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 23:08:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 23:08:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 23:08:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-08 23:08:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:08:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:08:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 23:08:19 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 23:08:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 2
2012-08-08 23:08:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:08:19 [DEBUG   ] Finished updating board flags in 0.911 seconds
2012-08-08 23:08:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 23:08:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 23:09:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 23:09:06 [DEBUG   ] Got command RPT from MCS: ref #7792
2012-08-08 23:09:06 [DEBUG   ] summary = NORMAL
2012-08-08 23:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7792  14 56147 83346285 A NORMALNORMAL'
2012-08-08 23:09:06 [DEBUG   ] Got command RPT from MCS: ref #7793
2012-08-08 23:09:06 [DEBUG   ] info = Warning condition cleared, system operating normally
2012-08-08 23:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7793  60 56147 83346285 A NORMALWarning condition cleared, system operating normally'
2012-08-08 23:09:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:09:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:09:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:09:18 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 23:09:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 23:09:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 23:09:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 23:09:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:09:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 23:09:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:09:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 23:09:19 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 23:09:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 3
2012-08-08 23:09:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:09:19 [DEBUG   ] Finished updating board flags in 0.915 seconds
2012-08-08 23:09:20 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-08 23:09:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 23:10:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 23:10:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:10:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:10:19 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 23:10:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 23:10:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 23:10:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:10:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:10:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:10:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 23:10:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 23:10:20 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 23:10:20 [DEBUG   ] Finished updating board flags in 1.348 seconds
2012-08-08 23:10:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 23:10:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 23:11:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 23:11:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:11:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:11:19 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-08 23:11:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 23:11:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 23:11:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:11:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:11:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:11:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 23:11:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 23:11:19 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 23:11:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 23:11:19 [DEBUG   ] Finished updating board flags in 1.091 seconds
2012-08-08 23:11:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-08 23:11:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 23:12:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 23:12:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:12:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:12:19 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-08 23:12:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 23:12:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2012-08-08 23:12:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 23:12:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 23:12:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 23:12:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:12:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:12:20 [DEBUG   ] Finished updating ant stats in 0.831 seconds
2012-08-08 23:12:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:12:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 23:12:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 23:12:20 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 23:12:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 23:12:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:12:20 [DEBUG   ] Finished updating board flags in 1.526 seconds
2012-08-08 23:12:40 [DEBUG   ] Finished updating ant stats in 0.774 seconds
2012-08-08 23:13:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 23:13:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 23:13:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 23:13:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-08 23:13:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:13:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:13:19 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 23:13:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 23:13:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:13:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:13:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:13:19 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 23:13:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 23:13:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 23:13:19 [DEBUG   ] Finished updating board flags in 0.838 seconds
2012-08-08 23:13:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-08 23:13:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 23:14:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 23:14:06 [DEBUG   ] Got command RPT from MCS: ref #7809
2012-08-08 23:14:06 [DEBUG   ] summary = NORMAL
2012-08-08 23:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7809  14 56147 83646292 A NORMALNORMAL'
2012-08-08 23:14:06 [DEBUG   ] Got command RPT from MCS: ref #7810
2012-08-08 23:14:06 [DEBUG   ] info = Warning condition cleared, system operating normally
2012-08-08 23:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7810  60 56147 83646293 A NORMALWarning condition cleared, system operating normally'
2012-08-08 23:14:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:14:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:14:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:14:19 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 23:14:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 23:14:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 23:14:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:14:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:14:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 23:14:20 [DEBUG   ] Finished updating ant stats in 0.625 seconds
2012-08-08 23:14:20 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 23:14:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:14:20 [DEBUG   ] Finished updating board flags in 1.316 seconds
2012-08-08 23:14:40 [DEBUG   ] Finished updating ant stats in 0.578 seconds
2012-08-08 23:15:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 23:15:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:15:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 23:15:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 23:15:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:15:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:15:19 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 23:15:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 23:15:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 23:15:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 23:15:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 23:15:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 23:15:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:15:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:15:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:15:20 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 23:15:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 23:15:20 [DEBUG   ] Finished updating board flags in 0.833 seconds
2012-08-08 23:15:20 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2012-08-08 23:15:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:16:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:16:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:16:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 23:16:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 23:16:19 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 23:16:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2012-08-08 23:16:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 23:16:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2012-08-08 23:16:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:16:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:16:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:16:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 23:16:20 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 23:16:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 23:16:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:16:20 [DEBUG   ] Finished updating board flags in 1.064 seconds
2012-08-08 23:16:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:16:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:17:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 23:17:19 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 23:17:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2012-08-08 23:17:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:17:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 23:17:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:17:19 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 23:17:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 23:17:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 23:17:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 5
2012-08-08 23:17:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 23:17:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:17:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:17:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:17:20 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-08 23:17:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 23:17:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:17:20 [DEBUG   ] Finished updating board flags in 1.018 seconds
2012-08-08 23:17:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:17:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:18:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:18:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:18:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 23:18:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 23:18:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:18:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:18:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 23:18:19 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 23:18:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 23:18:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 23:18:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 23:18:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 23:18:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:18:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:18:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:18:20 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 23:18:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 23:18:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:18:20 [DEBUG   ] Finished updating board flags in 1.039 seconds
2012-08-08 23:18:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:18:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:19:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 23:19:06 [DEBUG   ] Got command RPT from MCS: ref #7826
2012-08-08 23:19:06 [DEBUG   ] summary = NORMAL
2012-08-08 23:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7826  14 56147 83946288 A NORMALNORMAL'
2012-08-08 23:19:06 [DEBUG   ] Got command RPT from MCS: ref #7827
2012-08-08 23:19:06 [DEBUG   ] info = Warning condition cleared, system operating normally
2012-08-08 23:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7827  60 56147 83946289 A NORMALWarning condition cleared, system operating normally'
2012-08-08 23:19:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-08 23:19:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 23:19:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:19:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 23:19:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:19:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:19:19 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 23:19:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2012-08-08 23:19:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 23:19:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 23:19:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:19:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:19:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:19:20 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 23:19:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 23:19:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:19:20 [DEBUG   ] Finished updating board flags in 1.076 seconds
2012-08-08 23:19:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:19:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:20:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 23:20:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:20:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:20:19 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 23:20:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 23:20:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 23:20:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 23:20:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-08 23:20:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:20:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:20:21 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 23:20:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:20:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 23:20:21 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 23:20:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 23:20:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:20:21 [DEBUG   ] Finished updating board flags in 2.015 seconds
2012-08-08 23:20:41 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2012-08-08 23:21:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 23:21:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:21:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 23:21:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 23:21:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:21:19 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 23:21:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 23:21:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:21:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:21:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:21:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 23:21:20 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 23:21:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:21:20 [DEBUG   ] Finished updating board flags in 0.881 seconds
2012-08-08 23:21:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 23:21:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 23:22:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 23:22:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:22:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:22:19 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 23:22:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 23:22:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa34, chip 1
2012-08-08 23:22:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:22:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:22:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:22:20 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 23:22:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 23:22:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 23:22:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:22:20 [DEBUG   ] Finished updating board flags in 0.896 seconds
2012-08-08 23:22:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 23:22:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 23:23:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 23:23:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:23:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:23:19 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 23:23:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 23:23:20 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 23:23:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 23:23:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa34, chip 1
2012-08-08 23:23:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2012-08-08 23:23:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:23:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:23:21 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-08 23:23:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:23:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 23:23:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-08 23:23:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 1
2012-08-08 23:23:21 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 23:23:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 2
2012-08-08 23:23:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 23:23:21 [DEBUG   ] Finished updating board flags in 1.814 seconds
2012-08-08 23:23:41 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-08 23:24:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 23:24:06 [DEBUG   ] Got command RPT from MCS: ref #7843
2012-08-08 23:24:06 [DEBUG   ] summary = NORMAL
2012-08-08 23:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7843  14 56147 84246289 A NORMALNORMAL'
2012-08-08 23:24:06 [DEBUG   ] Got command RPT from MCS: ref #7844
2012-08-08 23:24:06 [DEBUG   ] info = Warning condition cleared, system operating normally
2012-08-08 23:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7844  60 56147 84246289 A NORMALWarning condition cleared, system operating normally'
2012-08-08 23:24:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:24:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 23:24:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:24:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:24:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 23:24:19 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 23:24:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 23:24:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 23:24:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:24:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:24:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 23:24:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:24:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 23:24:20 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 23:24:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 23:24:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:24:20 [DEBUG   ] Finished updating board flags in 0.895 seconds
2012-08-08 23:24:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 23:24:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 23:25:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 23:25:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 23:25:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:25:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 23:25:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 4
2012-08-08 23:25:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 23:25:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 23:25:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:25:20 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 23:25:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2012-08-08 23:25:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:25:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:25:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:25:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-08 23:25:20 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 23:25:20 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 23:25:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 23:25:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:25:20 [DEBUG   ] Finished updating board flags in 0.948 seconds
2012-08-08 23:25:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 23:25:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 23:26:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 23:26:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 23:26:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:26:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:26:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 23:26:20 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 23:26:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 23:26:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 23:26:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 23:26:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:26:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:26:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 5
2012-08-08 23:26:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:26:20 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 23:26:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 23:26:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 4
2012-08-08 23:26:20 [DEBUG   ] Finished updating board flags in 1.056 seconds
2012-08-08 23:26:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 23:26:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 23:27:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 23:27:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:27:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:27:20 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 23:27:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-08 23:27:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 23:27:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 23:27:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-08 23:27:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:27:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:27:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 23:27:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 23:27:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:27:20 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 23:27:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 23:27:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:27:20 [DEBUG   ] Finished updating board flags in 1.014 seconds
2012-08-08 23:27:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 23:27:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 23:28:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 23:28:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:28:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:28:20 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 23:28:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2012-08-08 23:28:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 23:28:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 23:28:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 23:28:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:28:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:28:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 23:28:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 23:28:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:28:20 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 23:28:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:28:21 [DEBUG   ] Finished updating board flags in 1.031 seconds
2012-08-08 23:28:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 23:28:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 23:29:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 23:29:06 [DEBUG   ] Got command RPT from MCS: ref #7860
2012-08-08 23:29:06 [DEBUG   ] summary = NORMAL
2012-08-08 23:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7860  14 56147 84546292 A NORMALNORMAL'
2012-08-08 23:29:06 [DEBUG   ] Got command RPT from MCS: ref #7861
2012-08-08 23:29:06 [DEBUG   ] info = Warning condition cleared, system operating normally
2012-08-08 23:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7861  60 56147 84546293 A NORMALWarning condition cleared, system operating normally'
2012-08-08 23:29:20 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-08 23:29:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 23:29:20 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 23:29:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-08 23:29:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:29:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:29:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:29:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 23:29:20 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 23:29:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 2
2012-08-08 23:29:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:29:21 [DEBUG   ] Finished updating board flags in 1.037 seconds
2012-08-08 23:29:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 23:29:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 23:30:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 23:30:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-08 23:30:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 23:30:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:30:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 23:30:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 23:30:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:30:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 23:30:20 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 23:30:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 23:30:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 23:30:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:30:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:30:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:30:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 23:30:21 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 23:30:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 4
2012-08-08 23:30:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:30:21 [DEBUG   ] Finished updating board flags in 1.055 seconds
2012-08-08 23:30:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 23:30:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 23:31:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-08 23:31:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 23:31:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:31:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 23:31:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:31:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:31:20 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 23:31:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 23:31:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 23:31:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:31:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:31:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:31:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 23:31:21 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 23:31:21 [DEBUG   ] Finished updating board flags in 1.101 seconds
2012-08-08 23:31:21 [DEBUG   ] Finished updating ant stats in 0.830 seconds
2012-08-08 23:31:41 [DEBUG   ] Finished updating ant stats in 0.774 seconds
2012-08-08 23:32:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-08 23:32:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:32:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-08 23:32:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 23:32:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 23:32:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:32:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:32:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 23:32:20 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 23:32:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 23:32:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 23:32:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 23:32:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:32:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:32:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 23:32:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:32:21 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 23:32:21 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 23:32:21 [DEBUG   ] Finished updating ant stats in 0.631 seconds
2012-08-08 23:32:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:32:21 [DEBUG   ] Finished updating board flags in 1.102 seconds
2012-08-08 23:32:41 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2012-08-08 23:33:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-08 23:33:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:33:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:33:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-08 23:33:20 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 23:33:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 23:33:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-08 23:33:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-08 23:33:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:33:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:33:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-08 23:33:21 [DEBUG   ] Finished updating ant stats in 0.434 seconds
2012-08-08 23:33:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:33:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 23:33:21 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 23:33:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:33:21 [DEBUG   ] Finished updating board flags in 1.230 seconds
2012-08-08 23:33:41 [DEBUG   ] Finished updating ant stats in 0.370 seconds
2012-08-08 23:34:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:34:06 [DEBUG   ] Got command RPT from MCS: ref #7877
2012-08-08 23:34:06 [DEBUG   ] summary = NORMAL
2012-08-08 23:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7877  14 56147 84846289 A NORMALNORMAL'
2012-08-08 23:34:06 [DEBUG   ] Got command RPT from MCS: ref #7878
2012-08-08 23:34:06 [DEBUG   ] info = Warning condition cleared, system operating normally
2012-08-08 23:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7878  60 56147 84846289 A NORMALWarning condition cleared, system operating normally'
2012-08-08 23:34:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2012-08-08 23:34:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:34:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 23:34:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:34:20 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 23:34:20 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 23:34:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2012-08-08 23:34:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:34:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:34:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 23:34:21 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 23:34:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 4
2012-08-08 23:34:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:34:21 [DEBUG   ] Finished updating board flags in 1.141 seconds
2012-08-08 23:34:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:34:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:35:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:35:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:35:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:35:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:35:20 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-08 23:35:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 23:35:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 23:35:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 23:35:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2012-08-08 23:35:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:35:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:35:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-08 23:35:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:35:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 23:35:21 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 23:35:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 23:35:21 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 23:35:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 23:35:21 [DEBUG   ] Finished updating board flags in 0.881 seconds
2012-08-08 23:35:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 23:35:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-08 23:36:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-08 23:36:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:36:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-08 23:36:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-08 23:36:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:36:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:36:20 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-08 23:36:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 23:36:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 23:36:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-08 23:36:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 23:36:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2012-08-08 23:36:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 23:36:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:36:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:36:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-08 23:36:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-08 23:36:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-08 23:36:22 [DEBUG   ] Finished updating board flags in 2.022 seconds
2012-08-08 23:36:42 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2012-08-08 23:37:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 23:37:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:37:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 23:37:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 23:37:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-08 23:37:20 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-08 23:37:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2012-08-08 23:37:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 23:37:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:37:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:37:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 23:37:21 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-08 23:37:21 [DEBUG   ] Finished updating board flags in 0.850 seconds
2012-08-08 23:37:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 23:37:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 23:38:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 23:38:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-08 23:38:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:38:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-08 23:38:20 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-08 23:38:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-08 23:38:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 23:38:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:38:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:38:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:38:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-08 23:38:21 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 23:38:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-08 23:38:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-08 23:38:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-08 23:38:21 [DEBUG   ] Finished updating board flags in 0.898 seconds
2012-08-08 23:38:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 23:38:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 23:39:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-08 23:39:06 [DEBUG   ] Got command RPT from MCS: ref #7894
2012-08-08 23:39:06 [DEBUG   ] summary = NORMAL
2012-08-08 23:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7894  14 56147 85146296 A NORMALNORMAL'
2012-08-08 23:39:06 [DEBUG   ] Got command RPT from MCS: ref #7895
2012-08-08 23:39:06 [DEBUG   ] info = Warning condition cleared, system operating normally
2012-08-08 23:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7895  60 56147 85146297 A NORMALWarning condition cleared, system operating normally'
2012-08-08 23:39:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-08 23:39:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-08 23:39:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-08 23:39:21 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-08 23:39:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-08 23:39:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-08 23:39:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-08 23:39:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-08 23:39:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-08 23:39:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-08 23:39:22 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-08 23:39:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-08 23:39:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-08 23:39:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-08 23:39:22 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-08 23:39:22 [DEBUG   ] Finished updating board flags in 1.833 seconds
2012-08-08 23:39:29 [DEBUG   ] Got command INI from MCS: ref #7911
2012-08-08 23:39:29 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2012-08-08 23:39:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI     7911   8 56147 85169820 ABOOTING'
2012-08-08 23:39:46 [INFO    ] -------------------
2012-08-08 23:39:46 [INFO    ]  LWA board status
2012-08-08 23:39:46 [INFO    ] -------------------
2012-08-08 23:39:46 [INFO    ] DP 1: 2 lwa27
2012-08-08 23:39:46 [INFO    ] DP 1: 3 lwa24
2012-08-08 23:39:46 [INFO    ] DP 1: 4 lwa23
2012-08-08 23:39:46 [INFO    ] DP 1: 5 lwa18
2012-08-08 23:39:46 [INFO    ] DP 1: 6 lwa10
2012-08-08 23:39:46 [INFO    ] DP 1: 7 lwa32
2012-08-08 23:39:46 [INFO    ] DP 1: 8 lwa11
2012-08-08 23:39:46 [INFO    ] DP 1: 9 lwa30
2012-08-08 23:39:46 [INFO    ] DP 1: 10 lwa12
2012-08-08 23:39:46 [INFO    ] DP 1: 11 lwa8
2012-08-08 23:39:46 [INFO    ] DP 1: 12 lwa13
2012-08-08 23:39:46 [INFO    ] DP 1: 13 lwa26
2012-08-08 23:39:46 [INFO    ] DP 1: 14 lwa14
2012-08-08 23:39:46 [INFO    ] DP 1: 16 lwa22
2012-08-08 23:39:46 [INFO    ] DP 1: 17 lwa20
2012-08-08 23:39:46 [INFO    ] DP 1: 18 lwa1
2012-08-08 23:39:46 [INFO    ] DP 1: 19 lwa5
2012-08-08 23:39:46 [INFO    ] DP 1: 20 lwa25
2012-08-08 23:39:46 [INFO    ] DP 1: 21 lwa35
2012-08-08 23:39:46 [INFO    ] DP 1: 22 lwa19
2012-08-08 23:39:46 [INFO    ] DP 1: 23 lwa21
2012-08-08 23:39:46 [INFO    ] DP 1: 24 lwa6
2012-08-08 23:39:46 [INFO    ] DP 1: 25 lwa7
2012-08-08 23:39:46 [INFO    ] DP 1: 26 lwa33
2012-08-08 23:39:46 [INFO    ] DP 1: 27 lwa15
2012-08-08 23:39:46 [INFO    ] DP 1: 28 lwa28
2012-08-08 23:39:46 [INFO    ] DP 2: 1 lwa16
2012-08-08 23:39:46 [INFO    ] DP 2: 15 lwa34
2012-08-08 23:39:46 [INFO    ] Total of 28 boards
2012-08-08 23:39:46 [INFO    ] Total of 260 stands
2012-08-08 23:39:46 [INFO    ] -------------------
2012-08-08 23:39:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:49 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:50 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27199
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27200
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27201
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27202
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27203
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27204
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27205
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27206
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27207
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27208
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27209
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27210
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27211
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27212
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27213
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27214
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27215
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27216
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27217
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27218
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27219
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27220
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27221
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27222
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27223
2012-08-08 23:39:53 [DEBUG   ] 2012-08-08 23:39:53 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 27224
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27199 exited with status 0
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27200 exited with status 0
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27201 exited with status 0
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27202 exited with status 0
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27203 exited with status 0
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27204 exited with status 0
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27205 exited with status 0
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27206 exited with status 0
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27207 exited with status 0
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27208 exited with status 0
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27209 exited with status 0
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27210 exited with status 0
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27211 exited with status 0
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27212 exited with status 0
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27213 exited with status 0
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27214 exited with status 0
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27215 exited with status 0
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27216 exited with status 0
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27217 exited with status 0
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27218 exited with status 0
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27219 exited with status 0
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27220 exited with status 0
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27221 exited with status 0
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27222 exited with status 0
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27223 exited with status 0
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 27224 exited with status 0
2012-08-08 23:40:05 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] spawn_process: at 2012-08-08 23:40:05 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 27261
2012-08-08 23:40:05 [DEBUG   ] 2012-08-08 23:40:05 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 27262
2012-08-08 23:40:11 [DEBUG   ] 2012-08-08 23:40:11 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 27261 exited with status 0
2012-08-08 23:40:11 [DEBUG   ] 2012-08-08 23:40:11 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 27262 exited with status 0
2012-08-08 23:40:11 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2012-08-08 23:40:11 [DEBUG   ] spawn_process: at 2012-08-08 23:40:11 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2012-08-08 23:40:11 [DEBUG   ] spawn_process: at 2012-08-08 23:40:11 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2012-08-08 23:40:11 [INFO    ] Setting Beam 1 xbars
2012-08-08 23:40:11 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2012-08-08 23:40:11 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2012-08-08 23:40:11 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2012-08-08 23:40:11 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2012-08-08 23:40:12 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2012-08-08 23:40:12 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2012-08-08 23:40:12 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2012-08-08 23:40:12 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2012-08-08 23:40:12 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2012-08-08 23:40:12 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2012-08-08 23:40:12 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2012-08-08 23:40:12 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2012-08-08 23:40:12 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2012-08-08 23:40:12 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2012-08-08 23:40:13 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2012-08-08 23:40:13 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2012-08-08 23:40:13 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2012-08-08 23:40:13 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2012-08-08 23:40:13 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2012-08-08 23:40:13 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2012-08-08 23:40:13 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2012-08-08 23:40:13 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2012-08-08 23:40:13 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2012-08-08 23:40:14 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2012-08-08 23:40:14 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2012-08-08 23:40:14 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2012-08-08 23:40:14 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2012-08-08 23:40:14 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2012-08-08 23:40:14 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2012-08-08 23:40:14 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2012-08-08 23:40:14 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2012-08-08 23:40:14 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2012-08-08 23:40:15 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2012-08-08 23:40:15 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2012-08-08 23:40:15 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2012-08-08 23:40:15 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2012-08-08 23:40:15 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2012-08-08 23:40:15 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2012-08-08 23:40:15 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2012-08-08 23:40:15 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2012-08-08 23:40:15 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2012-08-08 23:40:16 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2012-08-08 23:40:16 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2012-08-08 23:40:16 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2012-08-08 23:40:16 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2012-08-08 23:40:16 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2012-08-08 23:40:16 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2012-08-08 23:40:16 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2012-08-08 23:40:16 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2012-08-08 23:40:16 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2012-08-08 23:40:17 [INFO    ] Setting Beam 2 xbars
2012-08-08 23:40:17 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2012-08-08 23:40:17 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2012-08-08 23:40:17 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2012-08-08 23:40:17 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2012-08-08 23:40:17 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2012-08-08 23:40:17 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2012-08-08 23:40:17 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2012-08-08 23:40:17 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2012-08-08 23:40:17 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2012-08-08 23:40:17 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2012-08-08 23:40:18 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2012-08-08 23:40:18 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2012-08-08 23:40:18 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2012-08-08 23:40:18 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2012-08-08 23:40:18 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2012-08-08 23:40:18 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2012-08-08 23:40:18 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2012-08-08 23:40:18 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2012-08-08 23:40:18 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2012-08-08 23:40:19 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2012-08-08 23:40:19 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2012-08-08 23:40:19 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2012-08-08 23:40:19 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2012-08-08 23:40:19 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2012-08-08 23:40:19 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2012-08-08 23:40:19 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2012-08-08 23:40:19 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2012-08-08 23:40:19 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2012-08-08 23:40:20 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2012-08-08 23:40:20 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2012-08-08 23:40:20 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2012-08-08 23:40:20 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2012-08-08 23:40:20 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2012-08-08 23:40:20 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2012-08-08 23:40:20 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2012-08-08 23:40:20 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2012-08-08 23:40:20 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2012-08-08 23:40:21 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2012-08-08 23:40:21 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2012-08-08 23:40:21 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2012-08-08 23:40:21 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2012-08-08 23:40:21 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2012-08-08 23:40:21 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2012-08-08 23:40:21 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2012-08-08 23:40:21 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2012-08-08 23:40:21 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2012-08-08 23:40:22 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2012-08-08 23:40:22 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2012-08-08 23:40:22 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2012-08-08 23:40:22 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2012-08-08 23:40:22 [INFO    ] Setting Beam 3 xbars
2012-08-08 23:40:22 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2012-08-08 23:40:22 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2012-08-08 23:40:22 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2012-08-08 23:40:22 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2012-08-08 23:40:22 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2012-08-08 23:40:23 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2012-08-08 23:40:23 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2012-08-08 23:40:23 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2012-08-08 23:40:23 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2012-08-08 23:40:23 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2012-08-08 23:40:23 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2012-08-08 23:40:23 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2012-08-08 23:40:23 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2012-08-08 23:40:23 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2012-08-08 23:40:24 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2012-08-08 23:40:24 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2012-08-08 23:40:24 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2012-08-08 23:40:24 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2012-08-08 23:40:24 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2012-08-08 23:40:24 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2012-08-08 23:40:24 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2012-08-08 23:40:24 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2012-08-08 23:40:25 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2012-08-08 23:40:25 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2012-08-08 23:40:25 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2012-08-08 23:40:25 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2012-08-08 23:40:25 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2012-08-08 23:40:25 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2012-08-08 23:40:25 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2012-08-08 23:40:25 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2012-08-08 23:40:25 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2012-08-08 23:40:25 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2012-08-08 23:40:26 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2012-08-08 23:40:26 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2012-08-08 23:40:26 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2012-08-08 23:40:26 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2012-08-08 23:40:26 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2012-08-08 23:40:26 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2012-08-08 23:40:26 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2012-08-08 23:40:26 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2012-08-08 23:40:26 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2012-08-08 23:40:27 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2012-08-08 23:40:27 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2012-08-08 23:40:27 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2012-08-08 23:40:27 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2012-08-08 23:40:27 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2012-08-08 23:40:27 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2012-08-08 23:40:27 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2012-08-08 23:40:27 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2012-08-08 23:40:27 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2012-08-08 23:40:28 [INFO    ] Setting Beam 4 xbars
2012-08-08 23:40:28 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2012-08-08 23:40:28 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 23:40:28 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 23:40:28 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-08 23:40:28 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-08 23:40:28 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2012-08-08 23:40:28 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2012-08-08 23:40:28 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2012-08-08 23:40:28 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2012-08-08 23:40:29 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2012-08-08 23:40:29 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2012-08-08 23:40:29 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2012-08-08 23:40:29 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2012-08-08 23:40:29 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2012-08-08 23:40:29 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2012-08-08 23:40:29 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2012-08-08 23:40:29 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2012-08-08 23:40:29 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2012-08-08 23:40:30 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2012-08-08 23:40:30 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2012-08-08 23:40:30 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2012-08-08 23:40:30 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2012-08-08 23:40:30 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2012-08-08 23:40:30 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2012-08-08 23:40:30 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2012-08-08 23:40:30 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2012-08-08 23:40:30 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2012-08-08 23:40:31 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2012-08-08 23:40:31 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2012-08-08 23:40:31 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2012-08-08 23:40:31 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2012-08-08 23:40:31 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2012-08-08 23:40:31 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2012-08-08 23:40:31 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2012-08-08 23:40:31 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2012-08-08 23:40:31 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2012-08-08 23:40:31 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2012-08-08 23:40:32 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2012-08-08 23:40:32 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2012-08-08 23:40:32 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2012-08-08 23:40:32 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2012-08-08 23:40:32 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2012-08-08 23:40:32 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2012-08-08 23:40:32 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2012-08-08 23:40:32 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2012-08-08 23:40:32 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2012-08-08 23:40:33 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2012-08-08 23:40:33 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2012-08-08 23:40:33 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2012-08-08 23:40:33 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2012-08-08 23:40:33 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2012-08-08 23:40:33 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2012-08-08 23:40:33 [INFO    ] All xbars set
2012-08-08 23:40:33 [INFO    ] Setting adder chain routing for all beams
2012-08-08 23:40:38 [INFO    ] Setting beam ids
2012-08-08 23:40:48 [INFO    ] Starting beam delay calibration
2012-08-08 23:40:50 [DEBUG   ] Got command RPT from MCS: ref #7912
2012-08-08 23:40:50 [DEBUG   ] summary = BOOTING
2012-08-08 23:40:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7912  15 56147 85250653 ABOOTINGBOOTING'
2012-08-08 23:41:00 [INFO    ] Beam 1 latency is 5721
2012-08-08 23:41:00 [INFO    ] Beam 2 latency is 5773
2012-08-08 23:41:00 [INFO    ] Beam 3 latency is 5791
2012-08-08 23:41:00 [INFO    ] Beam 4 latency is 5726
2012-08-08 23:41:00 [INFO    ] Stop calibration
2012-08-08 23:41:08 [INFO    ] Beam delay calibration successful
2012-08-08 23:41:08 [INFO    ] Calibration passed
2012-08-08 23:41:08 [DEBUG   ] spawn_process: at 2012-08-08 23:41:08 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2012-08-08 23:41:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2012-08-08 23:41:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2012-08-08 23:41:08 [DEBUG   ] spawn_process: at 2012-08-08 23:41:08 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2012-08-08 23:41:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2012-08-08 23:41:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2012-08-08 23:41:08 [DEBUG   ] spawn_process: at 2012-08-08 23:41:08 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2012-08-08 23:41:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2012-08-08 23:41:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2012-08-08 23:41:08 [DEBUG   ] spawn_process: at 2012-08-08 23:41:08 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2012-08-08 23:41:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2012-08-08 23:41:08 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2012-08-08 23:41:10 [INFO    ] Started antennas statistics background thread
2012-08-08 23:41:10 [INFO    ] Started board flags background thread
2012-08-08 23:41:10 [INFO    ] Started BAM background thread
2012-08-08 23:41:10 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 with PID 28863
2012-08-08 23:41:10 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 with PID 28866
2012-08-08 23:41:10 [INFO    ] Finished the INI process in 100.416 s
2012-08-08 23:41:10 [DEBUG   ] Finished updating ant stats in 1.276 seconds
2012-08-08 23:41:10 [DEBUG   ] Finished updating board flags in 0.868 seconds
2012-08-08 23:41:30 [DEBUG   ] Finished updating ant stats in 1.178 seconds
2012-08-08 23:41:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 23:42:10 [DEBUG   ] Finished updating ant stats in 1.029 seconds
2012-08-08 23:42:10 [DEBUG   ] Finished updating board flags in 0.875 seconds
2012-08-08 23:42:30 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2012-08-08 23:42:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 23:43:10 [DEBUG   ] Finished updating ant stats in 0.829 seconds
2012-08-08 23:43:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2012-08-08 23:43:10 [DEBUG   ] Finished updating board flags in 0.837 seconds
2012-08-08 23:43:30 [DEBUG   ] Finished updating ant stats in 0.775 seconds
2012-08-08 23:43:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 23:44:06 [DEBUG   ] Got command RPT from MCS: ref #7913
2012-08-08 23:44:06 [DEBUG   ] summary = NORMAL
2012-08-08 23:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7913  14 56147 85446297 A NORMALNORMAL'
2012-08-08 23:44:06 [DEBUG   ] Got command RPT from MCS: ref #7914
2012-08-08 23:44:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 23:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7914  48 56147 85446297 A NORMALSystem calibrated and operating normally'
2012-08-08 23:44:10 [DEBUG   ] Finished updating ant stats in 0.628 seconds
2012-08-08 23:44:11 [DEBUG   ] Finished updating board flags in 0.831 seconds
2012-08-08 23:44:13 [DEBUG   ] Got command RPT from MCS: ref #7930
2012-08-08 23:44:13 [DEBUG   ] summary = NORMAL
2012-08-08 23:44:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7930  14 56147 85453964 A NORMALNORMAL'
2012-08-08 23:44:30 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2012-08-08 23:44:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-08 23:45:10 [DEBUG   ] Finished updating ant stats in 0.417 seconds
2012-08-08 23:45:11 [DEBUG   ] Finished updating board flags in 0.828 seconds
2012-08-08 23:45:24 [DEBUG   ] Got command TBN from MCS: ref #7935
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '1', '1344469526']
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '2', '1344469526']
2012-08-08 23:45:24 [DEBUG   ] tbn = exited with status True, code 0x00
2012-08-08 23:45:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN     7935   8 56147 85524889 A NORMAL'
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '3', '1344469526']
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '4', '1344469526']
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '5', '1344469526']
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '6', '1344469526']
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '7', '1344469526']
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '8', '1344469526']
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '9', '1344469526']
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '10', '1344469526']
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '11', '1344469526']
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '12', '1344469526']
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '13', '1344469526']
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '14', '1344469526']
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '15', '1344469526']
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '16', '1344469526']
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '17', '1344469526']
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '18', '1344469526']
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '19', '1344469526']
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '20', '1344469526']
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '21', '1344469526']
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '22', '1344469526']
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '23', '1344469526']
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '24', '1344469526']
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '25', '1344469526']
2012-08-08 23:45:24 [DEBUG   ] spawn_process: at 2012-08-08 23:45:24 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '26', '1344469526']
2012-08-08 23:45:24 [INFO    ] Finished spawning TBN in 0.049 s
2012-08-08 23:45:30 [DEBUG   ] Finished updating ant stats in 0.454 seconds
2012-08-08 23:45:51 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-08 23:46:10 [DEBUG   ] Finished updating ant stats in 0.446 seconds
2012-08-08 23:46:11 [DEBUG   ] Finished updating board flags in 1.231 seconds
2012-08-08 23:46:31 [DEBUG   ] Finished updating ant stats in 1.359 seconds
2012-08-08 23:46:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 23:47:11 [DEBUG   ] Finished updating ant stats in 1.238 seconds
2012-08-08 23:47:11 [DEBUG   ] Finished updating board flags in 1.293 seconds
2012-08-08 23:47:31 [DEBUG   ] Finished updating ant stats in 1.163 seconds
2012-08-08 23:47:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 23:48:11 [DEBUG   ] Finished updating ant stats in 1.044 seconds
2012-08-08 23:48:11 [DEBUG   ] Finished updating board flags in 1.430 seconds
2012-08-08 23:48:31 [DEBUG   ] Finished updating ant stats in 0.964 seconds
2012-08-08 23:48:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 23:49:06 [DEBUG   ] Got command RPT from MCS: ref #7936
2012-08-08 23:49:06 [DEBUG   ] summary = NORMAL
2012-08-08 23:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7936  14 56147 85746301 A NORMALNORMAL'
2012-08-08 23:49:06 [DEBUG   ] Got command RPT from MCS: ref #7937
2012-08-08 23:49:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 23:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7937  48 56147 85746301 A NORMALSystem calibrated and operating normally'
2012-08-08 23:49:11 [DEBUG   ] Finished updating ant stats in 0.642 seconds
2012-08-08 23:49:11 [DEBUG   ] Finished updating board flags in 1.456 seconds
2012-08-08 23:49:31 [DEBUG   ] Finished updating ant stats in 0.564 seconds
2012-08-08 23:49:52 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-08 23:50:11 [DEBUG   ] Finished updating board flags in 1.434 seconds
2012-08-08 23:50:12 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-08 23:50:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 23:50:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-08 23:51:11 [DEBUG   ] Finished updating board flags in 1.304 seconds
2012-08-08 23:51:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 23:51:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 23:51:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 23:52:11 [DEBUG   ] Finished updating board flags in 1.301 seconds
2012-08-08 23:52:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 23:52:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-08 23:52:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-08 23:53:12 [DEBUG   ] Finished updating board flags in 1.507 seconds
2012-08-08 23:53:12 [DEBUG   ] Finished updating ant stats in 0.632 seconds
2012-08-08 23:53:32 [DEBUG   ] Finished updating ant stats in 0.572 seconds
2012-08-08 23:53:53 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2012-08-08 23:54:06 [DEBUG   ] Got command RPT from MCS: ref #7953
2012-08-08 23:54:06 [DEBUG   ] summary = NORMAL
2012-08-08 23:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7953  14 56147 86046297 A NORMALNORMAL'
2012-08-08 23:54:06 [DEBUG   ] Got command RPT from MCS: ref #7954
2012-08-08 23:54:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 23:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7954  48 56147 86046297 A NORMALSystem calibrated and operating normally'
2012-08-08 23:54:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-08 23:54:12 [DEBUG   ] Finished updating board flags in 1.392 seconds
2012-08-08 23:54:13 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-08 23:54:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-08 23:54:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-08 23:55:12 [DEBUG   ] Finished updating board flags in 1.277 seconds
2012-08-08 23:55:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 23:55:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-08 23:55:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 23:56:12 [DEBUG   ] Finished updating board flags in 1.278 seconds
2012-08-08 23:56:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-08 23:56:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-08 23:56:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 23:57:12 [DEBUG   ] Finished updating board flags in 1.276 seconds
2012-08-08 23:57:13 [DEBUG   ] Finished updating ant stats in 0.784 seconds
2012-08-08 23:57:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-08 23:57:54 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-08 23:58:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-08 23:58:12 [DEBUG   ] Finished updating board flags in 1.277 seconds
2012-08-08 23:58:14 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-08 23:58:34 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2012-08-08 23:58:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-08 23:59:06 [DEBUG   ] Got command RPT from MCS: ref #7970
2012-08-08 23:59:06 [DEBUG   ] summary = NORMAL
2012-08-08 23:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7970  14 56147 86346296 A NORMALNORMAL'
2012-08-08 23:59:06 [DEBUG   ] Got command RPT from MCS: ref #7971
2012-08-08 23:59:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-08 23:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7971  48 56147 86346297 A NORMALSystem calibrated and operating normally'
2012-08-08 23:59:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-08 23:59:12 [DEBUG   ] Finished updating board flags in 1.278 seconds
2012-08-08 23:59:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-08 23:59:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-08 23:59:54 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2012-08-09 00:00:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 00:00:12 [DEBUG   ] Finished updating board flags in 1.444 seconds
2012-08-09 00:00:14 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2012-08-09 00:00:35 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-09 00:00:55 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 00:01:12 [DEBUG   ] Finished updating board flags in 1.330 seconds
2012-08-09 00:01:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 00:01:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 00:01:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 00:02:12 [DEBUG   ] Finished updating board flags in 1.227 seconds
2012-08-09 00:02:15 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2012-08-09 00:02:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 00:02:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 00:03:12 [DEBUG   ] Finished updating board flags in 1.268 seconds
2012-08-09 00:03:15 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-09 00:03:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 00:03:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 00:04:06 [DEBUG   ] Got command RPT from MCS: ref #7987
2012-08-09 00:04:06 [DEBUG   ] summary = NORMAL
2012-08-09 00:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7987  14 56148   246293 A NORMALNORMAL'
2012-08-09 00:04:06 [DEBUG   ] Got command RPT from MCS: ref #7988
2012-08-09 00:04:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 00:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7988  48 56148   246293 A NORMALSystem calibrated and operating normally'
2012-08-09 00:04:12 [DEBUG   ] Finished updating board flags in 1.267 seconds
2012-08-09 00:04:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 00:04:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 00:04:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 00:05:13 [DEBUG   ] Finished updating board flags in 1.466 seconds
2012-08-09 00:05:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 00:05:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 00:05:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 00:06:13 [DEBUG   ] Finished updating board flags in 1.409 seconds
2012-08-09 00:06:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 00:06:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 00:06:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 00:07:13 [DEBUG   ] Finished updating board flags in 1.433 seconds
2012-08-09 00:07:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 00:07:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 00:07:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 00:08:13 [DEBUG   ] Finished updating board flags in 1.467 seconds
2012-08-09 00:08:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 00:08:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 00:08:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 00:09:06 [DEBUG   ] Got command RPT from MCS: ref #8004
2012-08-09 00:09:06 [DEBUG   ] summary = NORMAL
2012-08-09 00:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8004  14 56148   546293 A NORMALNORMAL'
2012-08-09 00:09:06 [DEBUG   ] Got command RPT from MCS: ref #8005
2012-08-09 00:09:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 00:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8005  48 56148   546293 A NORMALSystem calibrated and operating normally'
2012-08-09 00:09:13 [DEBUG   ] Finished updating board flags in 1.468 seconds
2012-08-09 00:09:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 00:09:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 00:09:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 00:10:13 [DEBUG   ] Finished updating board flags in 1.478 seconds
2012-08-09 00:10:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 00:10:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 00:10:56 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-09 00:11:13 [DEBUG   ] Finished updating board flags in 1.473 seconds
2012-08-09 00:11:16 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 00:11:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 00:11:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 00:12:13 [DEBUG   ] Finished updating board flags in 1.468 seconds
2012-08-09 00:12:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 00:12:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 00:12:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 00:13:13 [DEBUG   ] Finished updating board flags in 1.473 seconds
2012-08-09 00:13:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 00:13:36 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2012-08-09 00:13:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 00:14:06 [DEBUG   ] Got command RPT from MCS: ref #8021
2012-08-09 00:14:06 [DEBUG   ] summary = NORMAL
2012-08-09 00:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8021  14 56148   846309 A NORMALNORMAL'
2012-08-09 00:14:06 [DEBUG   ] Got command RPT from MCS: ref #8022
2012-08-09 00:14:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 00:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8022  48 56148   846309 A NORMALSystem calibrated and operating normally'
2012-08-09 00:14:13 [DEBUG   ] Finished updating board flags in 1.474 seconds
2012-08-09 00:14:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 00:14:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 00:14:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 00:15:13 [DEBUG   ] Finished updating board flags in 1.481 seconds
2012-08-09 00:15:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 00:15:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 00:15:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 00:16:13 [DEBUG   ] Finished updating board flags in 1.648 seconds
2012-08-09 00:16:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 00:16:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 00:16:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 00:17:13 [DEBUG   ] Finished updating board flags in 1.321 seconds
2012-08-09 00:17:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 00:17:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 00:17:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 00:18:13 [DEBUG   ] Finished updating board flags in 1.238 seconds
2012-08-09 00:18:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 00:18:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 00:18:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 00:19:06 [DEBUG   ] Got command RPT from MCS: ref #8038
2012-08-09 00:19:06 [DEBUG   ] summary = NORMAL
2012-08-09 00:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8038  14 56148  1146300 A NORMALNORMAL'
2012-08-09 00:19:06 [DEBUG   ] Got command RPT from MCS: ref #8039
2012-08-09 00:19:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 00:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8039  48 56148  1146301 A NORMALSystem calibrated and operating normally'
2012-08-09 00:19:13 [DEBUG   ] Finished updating board flags in 1.240 seconds
2012-08-09 00:19:16 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2012-08-09 00:19:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 00:19:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 00:20:13 [DEBUG   ] Finished updating board flags in 1.241 seconds
2012-08-09 00:20:16 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2012-08-09 00:20:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 00:20:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 00:21:13 [DEBUG   ] Finished updating board flags in 1.242 seconds
2012-08-09 00:21:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 00:21:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 00:21:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 00:22:14 [DEBUG   ] Finished updating board flags in 1.444 seconds
2012-08-09 00:22:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 00:22:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 00:22:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 00:23:14 [DEBUG   ] Finished updating board flags in 1.531 seconds
2012-08-09 00:23:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 00:23:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 00:23:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 00:24:06 [DEBUG   ] Got command RPT from MCS: ref #8055
2012-08-09 00:24:06 [DEBUG   ] summary = NORMAL
2012-08-09 00:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8055  14 56148  1446297 A NORMALNORMAL'
2012-08-09 00:24:06 [DEBUG   ] Got command RPT from MCS: ref #8056
2012-08-09 00:24:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 00:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8056  48 56148  1446297 A NORMALSystem calibrated and operating normally'
2012-08-09 00:24:14 [DEBUG   ] Finished updating board flags in 1.467 seconds
2012-08-09 00:24:16 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2012-08-09 00:24:36 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-09 00:24:57 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-09 00:25:14 [DEBUG   ] Finished updating board flags in 1.476 seconds
2012-08-09 00:25:17 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-09 00:25:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 00:25:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 00:26:14 [DEBUG   ] Finished updating board flags in 1.469 seconds
2012-08-09 00:26:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 00:26:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 00:26:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 00:27:13 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 00:27:14 [DEBUG   ] Finished updating board flags in 1.473 seconds
2012-08-09 00:27:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 00:27:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 00:27:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 00:28:14 [DEBUG   ] Finished updating board flags in 1.489 seconds
2012-08-09 00:28:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 00:28:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 00:28:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 00:29:06 [DEBUG   ] Got command RPT from MCS: ref #8072
2012-08-09 00:29:06 [DEBUG   ] summary = NORMAL
2012-08-09 00:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8072  14 56148  1746300 A NORMALNORMAL'
2012-08-09 00:29:06 [DEBUG   ] Got command RPT from MCS: ref #8073
2012-08-09 00:29:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 00:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8073  48 56148  1746301 A NORMALSystem calibrated and operating normally'
2012-08-09 00:29:14 [DEBUG   ] Finished updating board flags in 1.493 seconds
2012-08-09 00:29:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 00:29:37 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 00:29:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 00:30:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-09 00:30:14 [DEBUG   ] Finished updating board flags in 1.691 seconds
2012-08-09 00:30:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 00:30:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 00:30:57 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 00:31:14 [DEBUG   ] Finished updating board flags in 1.626 seconds
2012-08-09 00:31:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 00:31:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 00:31:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 00:32:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 00:32:14 [DEBUG   ] Finished updating board flags in 1.306 seconds
2012-08-09 00:32:17 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 00:32:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 00:32:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 00:33:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 00:33:14 [DEBUG   ] Finished updating board flags in 1.237 seconds
2012-08-09 00:33:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 00:33:37 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 00:33:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 00:34:06 [DEBUG   ] Got command RPT from MCS: ref #8089
2012-08-09 00:34:06 [DEBUG   ] summary = NORMAL
2012-08-09 00:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8089  14 56148  2046305 A NORMALNORMAL'
2012-08-09 00:34:06 [DEBUG   ] Got command RPT from MCS: ref #8090
2012-08-09 00:34:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 00:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8090  48 56148  2046305 A NORMALSystem calibrated and operating normally'
2012-08-09 00:34:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 00:34:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 00:34:14 [DEBUG   ] Finished updating board flags in 1.233 seconds
2012-08-09 00:34:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 00:34:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 00:34:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 00:35:14 [DEBUG   ] Finished updating board flags in 1.235 seconds
2012-08-09 00:35:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 00:35:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 00:35:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 00:36:15 [DEBUG   ] Finished updating board flags in 1.633 seconds
2012-08-09 00:36:17 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 00:36:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 00:36:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 00:37:15 [DEBUG   ] Finished updating board flags in 1.479 seconds
2012-08-09 00:37:17 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2012-08-09 00:37:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 00:37:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 00:38:15 [DEBUG   ] Finished updating board flags in 1.410 seconds
2012-08-09 00:38:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 00:38:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 00:38:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 00:39:06 [DEBUG   ] Got command RPT from MCS: ref #8106
2012-08-09 00:39:06 [DEBUG   ] summary = NORMAL
2012-08-09 00:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8106  14 56148  2346309 A NORMALNORMAL'
2012-08-09 00:39:06 [DEBUG   ] Got command RPT from MCS: ref #8107
2012-08-09 00:39:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 00:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8107  48 56148  2346309 A NORMALSystem calibrated and operating normally'
2012-08-09 00:39:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 00:39:15 [DEBUG   ] Finished updating board flags in 1.392 seconds
2012-08-09 00:39:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 00:39:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 00:39:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 00:40:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 00:40:15 [DEBUG   ] Finished updating board flags in 1.391 seconds
2012-08-09 00:40:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 00:40:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 00:40:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 00:41:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 00:41:15 [DEBUG   ] Finished updating board flags in 1.398 seconds
2012-08-09 00:41:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 00:41:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 00:41:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 00:42:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 00:42:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 00:42:15 [DEBUG   ] Finished updating board flags in 1.608 seconds
2012-08-09 00:42:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 00:42:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 00:42:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 00:43:15 [DEBUG   ] Finished updating board flags in 1.667 seconds
2012-08-09 00:43:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 00:43:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 00:43:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 00:44:06 [DEBUG   ] Got command RPT from MCS: ref #8123
2012-08-09 00:44:06 [DEBUG   ] summary = NORMAL
2012-08-09 00:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8123  14 56148  2646305 A NORMALNORMAL'
2012-08-09 00:44:06 [DEBUG   ] Got command RPT from MCS: ref #8124
2012-08-09 00:44:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 00:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8124  48 56148  2646305 A NORMALSystem calibrated and operating normally'
2012-08-09 00:44:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 00:44:16 [DEBUG   ] Finished updating board flags in 1.850 seconds
2012-08-09 00:44:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 00:44:37 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2012-08-09 00:44:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 00:45:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 00:45:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 00:45:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 00:45:15 [DEBUG   ] Finished updating board flags in 1.305 seconds
2012-08-09 00:45:17 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2012-08-09 00:45:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 00:45:58 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2012-08-09 00:46:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 00:46:15 [DEBUG   ] Finished updating board flags in 1.234 seconds
2012-08-09 00:46:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 00:46:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 00:46:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 00:47:15 [DEBUG   ] Finished updating board flags in 1.261 seconds
2012-08-09 00:47:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 00:47:38 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 00:47:58 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 00:48:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 00:48:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 00:48:15 [DEBUG   ] Finished updating board flags in 1.243 seconds
2012-08-09 00:48:18 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2012-08-09 00:48:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-09 00:48:59 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2012-08-09 00:49:06 [DEBUG   ] Got command RPT from MCS: ref #8140
2012-08-09 00:49:06 [DEBUG   ] summary = NORMAL
2012-08-09 00:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8140  14 56148  2946305 A NORMALNORMAL'
2012-08-09 00:49:06 [DEBUG   ] Got command RPT from MCS: ref #8141
2012-08-09 00:49:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 00:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8141  48 56148  2946305 A NORMALSystem calibrated and operating normally'
2012-08-09 00:49:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 00:49:15 [DEBUG   ] Finished updating board flags in 1.236 seconds
2012-08-09 00:49:19 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-09 00:49:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 00:49:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 00:50:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 00:50:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 00:50:16 [DEBUG   ] Finished updating board flags in 1.430 seconds
2012-08-09 00:50:19 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2012-08-09 00:50:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 00:50:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 00:51:16 [DEBUG   ] Finished updating board flags in 1.388 seconds
2012-08-09 00:51:19 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 00:51:39 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 00:51:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 00:52:16 [DEBUG   ] Finished updating board flags in 1.243 seconds
2012-08-09 00:52:19 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2012-08-09 00:52:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 00:53:00 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2012-08-09 00:53:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 00:53:16 [DEBUG   ] Finished updating board flags in 1.256 seconds
2012-08-09 00:53:20 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-09 00:53:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 00:54:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 00:54:06 [DEBUG   ] Got command RPT from MCS: ref #8157
2012-08-09 00:54:06 [DEBUG   ] summary = NORMAL
2012-08-09 00:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8157  14 56148  3246313 A NORMALNORMAL'
2012-08-09 00:54:06 [DEBUG   ] Got command RPT from MCS: ref #8158
2012-08-09 00:54:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 00:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8158  48 56148  3246313 A NORMALSystem calibrated and operating normally'
2012-08-09 00:54:16 [DEBUG   ] Finished updating board flags in 1.231 seconds
2012-08-09 00:54:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 00:54:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 00:55:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 00:55:16 [DEBUG   ] Finished updating board flags in 1.252 seconds
2012-08-09 00:55:20 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-09 00:55:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 00:56:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 00:56:16 [DEBUG   ] Finished updating board flags in 1.244 seconds
2012-08-09 00:56:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 00:56:40 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 00:57:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 00:57:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 00:57:16 [DEBUG   ] Finished updating board flags in 1.239 seconds
2012-08-09 00:57:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 00:57:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 00:58:00 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 00:58:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2012-08-09 00:58:16 [DEBUG   ] Finished updating board flags in 1.239 seconds
2012-08-09 00:58:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 00:58:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 00:59:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 00:59:06 [DEBUG   ] Got command RPT from MCS: ref #8174
2012-08-09 00:59:06 [DEBUG   ] summary = NORMAL
2012-08-09 00:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8174  14 56148  3546313 A NORMALNORMAL'
2012-08-09 00:59:06 [DEBUG   ] Got command RPT from MCS: ref #8175
2012-08-09 00:59:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 00:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8175  48 56148  3546313 A NORMALSystem calibrated and operating normally'
2012-08-09 00:59:16 [DEBUG   ] Finished updating board flags in 1.286 seconds
2012-08-09 00:59:20 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-09 00:59:41 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2012-08-09 01:00:01 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-09 01:00:16 [DEBUG   ] Finished updating board flags in 1.288 seconds
2012-08-09 01:00:21 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2012-08-09 01:00:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 01:01:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 01:01:16 [DEBUG   ] Finished updating board flags in 1.438 seconds
2012-08-09 01:01:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 01:01:41 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 01:02:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 01:02:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 01:02:16 [DEBUG   ] Finished updating board flags in 1.322 seconds
2012-08-09 01:02:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 01:02:41 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2012-08-09 01:03:02 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-09 01:03:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-09 01:03:16 [DEBUG   ] Finished updating board flags in 1.238 seconds
2012-08-09 01:03:22 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-09 01:03:42 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-09 01:04:02 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 01:04:06 [DEBUG   ] Got command RPT from MCS: ref #8191
2012-08-09 01:04:06 [DEBUG   ] summary = NORMAL
2012-08-09 01:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8191  14 56148  3846309 A NORMALNORMAL'
2012-08-09 01:04:06 [DEBUG   ] Got command RPT from MCS: ref #8192
2012-08-09 01:04:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 01:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8192  48 56148  3846309 A NORMALSystem calibrated and operating normally'
2012-08-09 01:04:16 [DEBUG   ] Finished updating board flags in 1.234 seconds
2012-08-09 01:04:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 01:04:42 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 01:05:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 01:05:16 [DEBUG   ] Finished updating board flags in 1.234 seconds
2012-08-09 01:05:22 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-09 01:05:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 01:06:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 01:06:16 [DEBUG   ] Finished updating board flags in 1.244 seconds
2012-08-09 01:06:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 01:06:42 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 01:07:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 01:07:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 01:07:17 [DEBUG   ] Finished updating board flags in 1.434 seconds
2012-08-09 01:07:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 01:07:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 01:08:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 01:08:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 01:08:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 01:08:17 [DEBUG   ] Finished updating board flags in 1.426 seconds
2012-08-09 01:08:22 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 01:08:42 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2012-08-09 01:09:03 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-09 01:09:06 [DEBUG   ] Got command RPT from MCS: ref #8208
2012-08-09 01:09:06 [DEBUG   ] summary = NORMAL
2012-08-09 01:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8208  14 56148  4146312 A NORMALNORMAL'
2012-08-09 01:09:06 [DEBUG   ] Got command RPT from MCS: ref #8209
2012-08-09 01:09:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 01:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8209  48 56148  4146313 A NORMALSystem calibrated and operating normally'
2012-08-09 01:09:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 01:09:17 [DEBUG   ] Finished updating board flags in 1.385 seconds
2012-08-09 01:09:23 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-09 01:09:43 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-09 01:10:03 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 01:10:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-09 01:10:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 01:10:17 [DEBUG   ] Finished updating board flags in 1.243 seconds
2012-08-09 01:10:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 01:10:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 01:11:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 01:11:17 [DEBUG   ] Finished updating board flags in 1.249 seconds
2012-08-09 01:11:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 01:11:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 01:12:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 01:12:17 [DEBUG   ] Finished updating board flags in 1.245 seconds
2012-08-09 01:12:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 01:12:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 01:13:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 01:13:17 [DEBUG   ] Finished updating board flags in 1.259 seconds
2012-08-09 01:13:23 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 01:13:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 01:14:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 01:14:06 [DEBUG   ] Got command RPT from MCS: ref #8225
2012-08-09 01:14:06 [DEBUG   ] summary = NORMAL
2012-08-09 01:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8225  14 56148  4446308 A NORMALNORMAL'
2012-08-09 01:14:06 [DEBUG   ] Got command RPT from MCS: ref #8226
2012-08-09 01:14:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 01:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8226  48 56148  4446309 A NORMALSystem calibrated and operating normally'
2012-08-09 01:14:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 01:14:17 [DEBUG   ] Finished updating board flags in 1.254 seconds
2012-08-09 01:14:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 01:14:43 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 01:15:04 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-09 01:15:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-09 01:15:17 [DEBUG   ] Finished updating board flags in 1.256 seconds
2012-08-09 01:15:24 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-09 01:15:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 01:16:04 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-09 01:16:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 01:16:17 [DEBUG   ] Finished updating board flags in 1.257 seconds
2012-08-09 01:16:24 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 01:16:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 01:17:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 01:17:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 01:17:17 [DEBUG   ] Finished updating board flags in 1.249 seconds
2012-08-09 01:17:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 01:17:44 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-09 01:18:05 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 01:18:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 01:18:17 [DEBUG   ] Finished updating board flags in 1.446 seconds
2012-08-09 01:18:25 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-09 01:18:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 01:19:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 01:19:06 [DEBUG   ] Got command RPT from MCS: ref #8242
2012-08-09 01:19:06 [DEBUG   ] summary = NORMAL
2012-08-09 01:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8242  14 56148  4746317 A NORMALNORMAL'
2012-08-09 01:19:06 [DEBUG   ] Got command RPT from MCS: ref #8243
2012-08-09 01:19:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 01:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8243  48 56148  4746317 A NORMALSystem calibrated and operating normally'
2012-08-09 01:19:17 [DEBUG   ] Finished updating board flags in 1.418 seconds
2012-08-09 01:19:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 01:19:45 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-09 01:20:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 01:20:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 01:20:17 [DEBUG   ] Finished updating board flags in 1.360 seconds
2012-08-09 01:20:25 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2012-08-09 01:20:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 01:21:06 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-09 01:21:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 01:21:17 [DEBUG   ] Finished updating board flags in 1.232 seconds
2012-08-09 01:21:25 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-09 01:21:46 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 01:22:06 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-09 01:22:17 [DEBUG   ] Finished updating board flags in 1.232 seconds
2012-08-09 01:22:26 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 01:22:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 01:23:06 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-09 01:23:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 01:23:17 [DEBUG   ] Finished updating board flags in 1.231 seconds
2012-08-09 01:23:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 01:23:46 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 01:24:06 [DEBUG   ] Got command RPT from MCS: ref #8259
2012-08-09 01:24:06 [DEBUG   ] summary = NORMAL
2012-08-09 01:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8259  14 56148  5046313 A NORMALNORMAL'
2012-08-09 01:24:06 [DEBUG   ] Got command RPT from MCS: ref #8260
2012-08-09 01:24:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 01:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8260  48 56148  5046314 A NORMALSystem calibrated and operating normally'
2012-08-09 01:24:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 01:24:17 [DEBUG   ] Finished updating board flags in 1.236 seconds
2012-08-09 01:24:26 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2012-08-09 01:24:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 01:25:06 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 01:25:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 01:25:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 01:25:17 [DEBUG   ] Finished updating board flags in 1.235 seconds
2012-08-09 01:25:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 01:25:46 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2012-08-09 01:26:07 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-09 01:26:18 [DEBUG   ] Finished updating board flags in 1.424 seconds
2012-08-09 01:26:26 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-09 01:26:47 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2012-08-09 01:27:07 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-09 01:27:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 01:27:18 [DEBUG   ] Finished updating board flags in 1.417 seconds
2012-08-09 01:27:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 01:27:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 01:28:07 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-09 01:28:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 01:28:18 [DEBUG   ] Finished updating board flags in 1.387 seconds
2012-08-09 01:28:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 01:28:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 01:29:06 [DEBUG   ] Got command RPT from MCS: ref #8276
2012-08-09 01:29:06 [DEBUG   ] summary = NORMAL
2012-08-09 01:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8276  14 56148  5346312 A NORMALNORMAL'
2012-08-09 01:29:06 [DEBUG   ] Got command RPT from MCS: ref #8277
2012-08-09 01:29:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 01:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8277  48 56148  5346313 A NORMALSystem calibrated and operating normally'
2012-08-09 01:29:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 01:29:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 01:29:18 [DEBUG   ] Finished updating board flags in 1.232 seconds
2012-08-09 01:29:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 01:29:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 01:30:07 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 01:30:18 [DEBUG   ] Finished updating board flags in 1.249 seconds
2012-08-09 01:30:27 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2012-08-09 01:30:48 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-09 01:31:08 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-09 01:31:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 01:31:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2012-08-09 01:31:18 [DEBUG   ] Finished updating board flags in 1.237 seconds
2012-08-09 01:31:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 01:31:48 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-09 01:32:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 01:32:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 01:32:18 [DEBUG   ] Finished updating board flags in 1.226 seconds
2012-08-09 01:32:28 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 01:32:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 01:33:09 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-09 01:33:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 01:33:18 [DEBUG   ] Finished updating board flags in 1.234 seconds
2012-08-09 01:33:28 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-09 01:33:49 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 01:34:06 [DEBUG   ] Got command RPT from MCS: ref #8293
2012-08-09 01:34:06 [DEBUG   ] summary = NORMAL
2012-08-09 01:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8293  14 56148  5646309 A NORMALNORMAL'
2012-08-09 01:34:06 [DEBUG   ] Got command RPT from MCS: ref #8294
2012-08-09 01:34:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 01:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8294  48 56148  5646309 A NORMALSystem calibrated and operating normally'
2012-08-09 01:34:09 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-09 01:34:18 [DEBUG   ] Finished updating board flags in 1.237 seconds
2012-08-09 01:34:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 01:34:49 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 01:35:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 01:35:18 [DEBUG   ] Finished updating board flags in 1.248 seconds
2012-08-09 01:35:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 01:35:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 01:36:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 01:36:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 01:36:18 [DEBUG   ] Finished updating board flags in 1.246 seconds
2012-08-09 01:36:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 01:36:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 01:37:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 01:37:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 01:37:18 [DEBUG   ] Finished updating board flags in 1.241 seconds
2012-08-09 01:37:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 01:37:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 01:38:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 01:38:18 [DEBUG   ] Finished updating board flags in 1.242 seconds
2012-08-09 01:38:29 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 01:38:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 01:39:06 [DEBUG   ] Got command RPT from MCS: ref #8310
2012-08-09 01:39:06 [DEBUG   ] summary = NORMAL
2012-08-09 01:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8310  14 56148  5946321 A NORMALNORMAL'
2012-08-09 01:39:06 [DEBUG   ] Got command RPT from MCS: ref #8311
2012-08-09 01:39:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 01:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8311  48 56148  5946321 A NORMALSystem calibrated and operating normally'
2012-08-09 01:39:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 01:39:18 [DEBUG   ] Finished updating board flags in 1.326 seconds
2012-08-09 01:39:29 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-09 01:39:50 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-09 01:40:10 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-09 01:40:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 01:40:18 [DEBUG   ] Finished updating board flags in 1.443 seconds
2012-08-09 01:40:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 01:40:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 01:41:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 01:41:18 [DEBUG   ] Finished updating board flags in 1.453 seconds
2012-08-09 01:41:30 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2012-08-09 01:41:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 01:42:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 01:42:18 [DEBUG   ] Finished updating board flags in 1.249 seconds
2012-08-09 01:42:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 01:42:50 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-09 01:43:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 01:43:18 [DEBUG   ] Finished updating board flags in 1.243 seconds
2012-08-09 01:43:30 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 01:43:50 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 01:44:06 [DEBUG   ] Got command RPT from MCS: ref #8327
2012-08-09 01:44:06 [DEBUG   ] summary = NORMAL
2012-08-09 01:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8327  14 56148  6246313 A NORMALNORMAL'
2012-08-09 01:44:06 [DEBUG   ] Got command RPT from MCS: ref #8328
2012-08-09 01:44:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 01:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8328  48 56148  6246313 A NORMALSystem calibrated and operating normally'
2012-08-09 01:44:10 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2012-08-09 01:44:18 [DEBUG   ] Finished updating board flags in 1.243 seconds
2012-08-09 01:44:31 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-09 01:44:51 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-09 01:45:11 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-09 01:45:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2012-08-09 01:45:18 [DEBUG   ] Finished updating board flags in 1.253 seconds
2012-08-09 01:45:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 01:45:51 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 01:46:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 01:46:19 [DEBUG   ] Finished updating board flags in 1.448 seconds
2012-08-09 01:46:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 01:46:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 01:47:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 01:47:19 [DEBUG   ] Finished updating board flags in 1.386 seconds
2012-08-09 01:47:31 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 01:47:52 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-09 01:48:12 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-09 01:48:19 [DEBUG   ] Finished updating board flags in 1.247 seconds
2012-08-09 01:48:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 01:48:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 01:49:06 [DEBUG   ] Got command RPT from MCS: ref #8344
2012-08-09 01:49:06 [DEBUG   ] summary = NORMAL
2012-08-09 01:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8344  14 56148  6546317 A NORMALNORMAL'
2012-08-09 01:49:06 [DEBUG   ] Got command RPT from MCS: ref #8345
2012-08-09 01:49:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 01:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8345  48 56148  6546317 A NORMALSystem calibrated and operating normally'
2012-08-09 01:49:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 01:49:19 [DEBUG   ] Finished updating board flags in 1.242 seconds
2012-08-09 01:49:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 01:49:52 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 01:50:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 01:50:19 [DEBUG   ] Finished updating board flags in 1.248 seconds
2012-08-09 01:50:32 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2012-08-09 01:50:53 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2012-08-09 01:51:13 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 01:51:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 01:51:19 [DEBUG   ] Finished updating board flags in 1.251 seconds
2012-08-09 01:51:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 01:51:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 01:52:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 01:52:19 [DEBUG   ] Finished updating board flags in 1.251 seconds
2012-08-09 01:52:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 01:52:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 01:53:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 01:53:19 [DEBUG   ] Finished updating board flags in 1.250 seconds
2012-08-09 01:53:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 01:53:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 01:54:06 [DEBUG   ] Got command RPT from MCS: ref #8361
2012-08-09 01:54:06 [DEBUG   ] summary = NORMAL
2012-08-09 01:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8361  14 56148  6846317 A NORMALNORMAL'
2012-08-09 01:54:06 [DEBUG   ] Got command RPT from MCS: ref #8362
2012-08-09 01:54:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 01:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8362  48 56148  6846317 A NORMALSystem calibrated and operating normally'
2012-08-09 01:54:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 01:54:19 [DEBUG   ] Finished updating board flags in 1.247 seconds
2012-08-09 01:54:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 01:54:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 01:55:14 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 01:55:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 01:55:19 [DEBUG   ] Finished updating board flags in 1.251 seconds
2012-08-09 01:55:34 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-09 01:55:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 01:56:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 01:56:19 [DEBUG   ] Finished updating board flags in 1.252 seconds
2012-08-09 01:56:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 01:56:54 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 01:57:14 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-09 01:57:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 01:57:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 01:57:19 [DEBUG   ] Finished updating board flags in 1.449 seconds
2012-08-09 01:57:34 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 01:57:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 01:58:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 01:58:19 [DEBUG   ] Finished updating board flags in 1.345 seconds
2012-08-09 01:58:35 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2012-08-09 01:58:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 01:59:06 [DEBUG   ] Got command RPT from MCS: ref #8378
2012-08-09 01:59:06 [DEBUG   ] summary = NORMAL
2012-08-09 01:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8378  14 56148  7146321 A NORMALNORMAL'
2012-08-09 01:59:06 [DEBUG   ] Got command RPT from MCS: ref #8379
2012-08-09 01:59:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 01:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8379  48 56148  7146321 A NORMALSystem calibrated and operating normally'
2012-08-09 01:59:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 01:59:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 01:59:19 [DEBUG   ] Finished updating board flags in 1.236 seconds
2012-08-09 01:59:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 01:59:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 02:00:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 02:00:19 [DEBUG   ] Finished updating board flags in 1.335 seconds
2012-08-09 02:00:35 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-09 02:00:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 02:01:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 02:01:20 [DEBUG   ] Finished updating board flags in 1.491 seconds
2012-08-09 02:01:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 02:01:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 02:02:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 02:02:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-09 02:02:20 [DEBUG   ] Finished updating board flags in 1.337 seconds
2012-08-09 02:02:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 02:02:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 02:03:15 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2012-08-09 02:03:20 [DEBUG   ] Finished updating board flags in 1.305 seconds
2012-08-09 02:03:36 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-09 02:03:56 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-09 02:04:06 [DEBUG   ] Got command RPT from MCS: ref #8395
2012-08-09 02:04:06 [DEBUG   ] summary = NORMAL
2012-08-09 02:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8395  14 56148  7446324 A NORMALNORMAL'
2012-08-09 02:04:06 [DEBUG   ] Got command RPT from MCS: ref #8396
2012-08-09 02:04:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 02:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8396  48 56148  7446325 A NORMALSystem calibrated and operating normally'
2012-08-09 02:04:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 02:04:20 [DEBUG   ] Finished updating board flags in 1.295 seconds
2012-08-09 02:04:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 02:04:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 02:05:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 02:05:20 [DEBUG   ] Finished updating board flags in 1.308 seconds
2012-08-09 02:05:36 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 02:05:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 02:06:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 02:06:20 [DEBUG   ] Finished updating board flags in 1.308 seconds
2012-08-09 02:06:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 02:06:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 02:07:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 02:07:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 02:07:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 02:07:20 [DEBUG   ] Finished updating board flags in 1.513 seconds
2012-08-09 02:07:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 02:07:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 02:08:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 02:08:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 02:08:20 [DEBUG   ] Finished updating board flags in 1.286 seconds
2012-08-09 02:08:36 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2012-08-09 02:08:57 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-09 02:09:06 [DEBUG   ] Got command RPT from MCS: ref #8412
2012-08-09 02:09:06 [DEBUG   ] summary = NORMAL
2012-08-09 02:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8412  14 56148  7746321 A NORMALNORMAL'
2012-08-09 02:09:06 [DEBUG   ] Got command RPT from MCS: ref #8413
2012-08-09 02:09:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 02:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8413  48 56148  7746321 A NORMALSystem calibrated and operating normally'
2012-08-09 02:09:17 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-09 02:09:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 02:09:20 [DEBUG   ] Finished updating board flags in 1.229 seconds
2012-08-09 02:09:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 02:09:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 02:10:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 02:10:20 [DEBUG   ] Finished updating board flags in 1.233 seconds
2012-08-09 02:10:37 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 02:10:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 02:11:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 02:11:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 02:11:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 02:11:20 [DEBUG   ] Finished updating board flags in 1.237 seconds
2012-08-09 02:11:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 02:11:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 02:12:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 02:12:20 [DEBUG   ] Finished updating board flags in 1.238 seconds
2012-08-09 02:12:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 02:12:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 02:13:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 02:13:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 02:13:21 [DEBUG   ] Finished updating board flags in 1.517 seconds
2012-08-09 02:13:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 02:13:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 02:14:06 [DEBUG   ] Got command RPT from MCS: ref #8429
2012-08-09 02:14:06 [DEBUG   ] summary = NORMAL
2012-08-09 02:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8429  14 56148  8046317 A NORMALNORMAL'
2012-08-09 02:14:06 [DEBUG   ] Got command RPT from MCS: ref #8430
2012-08-09 02:14:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 02:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8430  48 56148  8046317 A NORMALSystem calibrated and operating normally'
2012-08-09 02:14:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 02:14:21 [DEBUG   ] Finished updating board flags in 1.442 seconds
2012-08-09 02:14:37 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-09 02:14:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 02:15:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 02:15:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-09 02:15:21 [DEBUG   ] Finished updating board flags in 1.358 seconds
2012-08-09 02:15:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 02:15:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 02:16:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 02:16:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 02:16:21 [DEBUG   ] Finished updating board flags in 1.391 seconds
2012-08-09 02:16:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 02:16:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 02:17:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 02:17:21 [DEBUG   ] Finished updating board flags in 1.424 seconds
2012-08-09 02:17:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 02:17:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 02:18:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 02:18:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 02:18:21 [DEBUG   ] Finished updating board flags in 1.421 seconds
2012-08-09 02:18:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 02:18:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 02:19:06 [DEBUG   ] Got command RPT from MCS: ref #8446
2012-08-09 02:19:06 [DEBUG   ] summary = NORMAL
2012-08-09 02:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8446  14 56148  8346321 A NORMALNORMAL'
2012-08-09 02:19:06 [DEBUG   ] Got command RPT from MCS: ref #8447
2012-08-09 02:19:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 02:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8447  48 56148  8346321 A NORMALSystem calibrated and operating normally'
2012-08-09 02:19:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 02:19:21 [DEBUG   ] Finished updating board flags in 1.465 seconds
2012-08-09 02:19:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 02:19:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 02:20:17 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2012-08-09 02:20:21 [DEBUG   ] Finished updating board flags in 1.490 seconds
2012-08-09 02:20:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 02:20:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 02:21:17 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2012-08-09 02:21:22 [DEBUG   ] Finished updating board flags in 1.672 seconds
2012-08-09 02:21:37 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-09 02:21:58 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-09 02:22:18 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 02:22:21 [DEBUG   ] Finished updating board flags in 1.311 seconds
2012-08-09 02:22:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 02:22:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 02:23:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 02:23:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 02:23:21 [DEBUG   ] Finished updating board flags in 1.230 seconds
2012-08-09 02:23:38 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2012-08-09 02:23:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 02:24:06 [DEBUG   ] Got command RPT from MCS: ref #8463
2012-08-09 02:24:06 [DEBUG   ] summary = NORMAL
2012-08-09 02:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8463  14 56148  8646329 A NORMALNORMAL'
2012-08-09 02:24:06 [DEBUG   ] Got command RPT from MCS: ref #8464
2012-08-09 02:24:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 02:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8464  48 56148  8646329 A NORMALSystem calibrated and operating normally'
2012-08-09 02:24:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 02:24:21 [DEBUG   ] Finished updating board flags in 1.233 seconds
2012-08-09 02:24:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 02:24:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 02:25:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 02:25:21 [DEBUG   ] Finished updating board flags in 1.249 seconds
2012-08-09 02:25:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 02:25:58 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 02:26:18 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 02:26:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 02:26:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 02:26:21 [DEBUG   ] Finished updating board flags in 1.238 seconds
2012-08-09 02:26:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 02:26:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 02:27:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 02:27:22 [DEBUG   ] Finished updating board flags in 1.505 seconds
2012-08-09 02:27:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 02:27:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 02:28:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 02:28:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 02:28:22 [DEBUG   ] Finished updating board flags in 1.351 seconds
2012-08-09 02:28:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 02:28:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 02:29:06 [DEBUG   ] Got command RPT from MCS: ref #8480
2012-08-09 02:29:06 [DEBUG   ] summary = NORMAL
2012-08-09 02:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8480  14 56148  8946321 A NORMALNORMAL'
2012-08-09 02:29:06 [DEBUG   ] Got command RPT from MCS: ref #8481
2012-08-09 02:29:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 02:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8481  48 56148  8946321 A NORMALSystem calibrated and operating normally'
2012-08-09 02:29:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 02:29:22 [DEBUG   ] Finished updating board flags in 1.413 seconds
2012-08-09 02:29:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 02:29:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 02:30:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 02:30:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 02:30:22 [DEBUG   ] Finished updating board flags in 1.366 seconds
2012-08-09 02:30:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 02:30:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 02:31:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 02:31:22 [DEBUG   ] Finished updating board flags in 1.377 seconds
2012-08-09 02:31:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 02:31:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 02:32:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 02:32:22 [DEBUG   ] Finished updating board flags in 1.409 seconds
2012-08-09 02:32:38 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 02:32:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 02:33:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 02:33:22 [DEBUG   ] Finished updating board flags in 1.417 seconds
2012-08-09 02:33:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 02:33:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 02:34:06 [DEBUG   ] Got command RPT from MCS: ref #8497
2012-08-09 02:34:06 [DEBUG   ] summary = NORMAL
2012-08-09 02:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8497  14 56148  9246333 A NORMALNORMAL'
2012-08-09 02:34:06 [DEBUG   ] Got command RPT from MCS: ref #8498
2012-08-09 02:34:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 02:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8498  48 56148  9246333 A NORMALSystem calibrated and operating normally'
2012-08-09 02:34:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 02:34:22 [DEBUG   ] Finished updating board flags in 1.413 seconds
2012-08-09 02:34:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 02:34:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 02:35:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 02:35:22 [DEBUG   ] Finished updating board flags in 1.612 seconds
2012-08-09 02:35:39 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-09 02:35:59 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-09 02:36:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 02:36:22 [DEBUG   ] Finished updating board flags in 1.611 seconds
2012-08-09 02:36:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 02:36:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 02:37:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 02:37:22 [DEBUG   ] Finished updating board flags in 1.647 seconds
2012-08-09 02:37:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 02:37:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 02:38:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 02:38:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 02:38:22 [DEBUG   ] Finished updating board flags in 1.635 seconds
2012-08-09 02:38:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 02:38:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 02:39:06 [DEBUG   ] Got command RPT from MCS: ref #8514
2012-08-09 02:39:06 [DEBUG   ] summary = NORMAL
2012-08-09 02:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8514  14 56148  9546325 A NORMALNORMAL'
2012-08-09 02:39:06 [DEBUG   ] Got command RPT from MCS: ref #8515
2012-08-09 02:39:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 02:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8515  48 56148  9546325 A NORMALSystem calibrated and operating normally'
2012-08-09 02:39:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 02:39:22 [DEBUG   ] Finished updating board flags in 1.348 seconds
2012-08-09 02:39:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 02:39:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 02:40:19 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-09 02:40:22 [DEBUG   ] Finished updating board flags in 1.244 seconds
2012-08-09 02:40:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 02:40:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 02:41:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 02:41:22 [DEBUG   ] Finished updating board flags in 1.248 seconds
2012-08-09 02:41:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 02:41:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 02:42:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 02:42:22 [DEBUG   ] Finished updating board flags in 1.246 seconds
2012-08-09 02:42:39 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 02:42:59 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2012-08-09 02:43:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 02:43:23 [DEBUG   ] Finished updating board flags in 1.436 seconds
2012-08-09 02:43:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 02:43:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 02:44:06 [DEBUG   ] Got command RPT from MCS: ref #8531
2012-08-09 02:44:06 [DEBUG   ] summary = NORMAL
2012-08-09 02:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8531  14 56148  9846328 A NORMALNORMAL'
2012-08-09 02:44:06 [DEBUG   ] Got command RPT from MCS: ref #8532
2012-08-09 02:44:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 02:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8532  48 56148  9846329 A NORMALSystem calibrated and operating normally'
2012-08-09 02:44:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 02:44:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 02:44:23 [DEBUG   ] Finished updating board flags in 1.507 seconds
2012-08-09 02:44:39 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-09 02:45:00 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-09 02:45:20 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-09 02:45:23 [DEBUG   ] Finished updating board flags in 1.301 seconds
2012-08-09 02:45:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 02:46:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 02:46:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 02:46:23 [DEBUG   ] Finished updating board flags in 1.240 seconds
2012-08-09 02:46:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 02:47:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 02:47:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 02:47:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2012-08-09 02:47:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 02:47:23 [DEBUG   ] Finished updating board flags in 1.238 seconds
2012-08-09 02:47:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 02:48:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 02:48:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 02:48:23 [DEBUG   ] Finished updating board flags in 1.247 seconds
2012-08-09 02:48:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 02:49:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 02:49:06 [DEBUG   ] Got command RPT from MCS: ref #8548
2012-08-09 02:49:06 [DEBUG   ] summary = NORMAL
2012-08-09 02:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8548  14 56148 10146333 A NORMALNORMAL'
2012-08-09 02:49:06 [DEBUG   ] Got command RPT from MCS: ref #8549
2012-08-09 02:49:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 02:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8549  48 56148 10146333 A NORMALSystem calibrated and operating normally'
2012-08-09 02:49:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 02:49:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 02:49:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 02:49:23 [DEBUG   ] Finished updating board flags in 1.242 seconds
2012-08-09 02:49:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 02:50:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 02:50:20 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2012-08-09 02:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2012-08-09 02:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2012-08-09 02:50:23 [DEBUG   ] Finished updating board flags in 1.327 seconds
2012-08-09 02:50:40 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2012-08-09 02:51:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 02:51:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2012-08-09 02:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2012-08-09 02:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2012-08-09 02:51:23 [DEBUG   ] Finished updating board flags in 1.327 seconds
2012-08-09 02:51:41 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-09 02:52:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 02:52:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 02:52:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 02:52:23 [DEBUG   ] Finished updating board flags in 1.498 seconds
2012-08-09 02:52:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 02:53:01 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 02:53:22 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-09 02:53:23 [DEBUG   ] Finished updating board flags in 1.417 seconds
2012-08-09 02:53:42 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-09 02:54:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 02:54:06 [DEBUG   ] Got command RPT from MCS: ref #8565
2012-08-09 02:54:06 [DEBUG   ] summary = NORMAL
2012-08-09 02:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8565  14 56148 10446328 A NORMALNORMAL'
2012-08-09 02:54:06 [DEBUG   ] Got command RPT from MCS: ref #8566
2012-08-09 02:54:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 02:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8566  48 56148 10446329 A NORMALSystem calibrated and operating normally'
2012-08-09 02:54:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 02:54:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 02:54:23 [DEBUG   ] Finished updating board flags in 1.294 seconds
2012-08-09 02:54:42 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 02:55:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 02:55:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 02:55:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 02:55:23 [DEBUG   ] Finished updating board flags in 1.235 seconds
2012-08-09 02:55:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 02:56:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 02:56:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 02:56:23 [DEBUG   ] Finished updating board flags in 1.312 seconds
2012-08-09 02:56:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 02:57:02 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2012-08-09 02:57:22 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-09 02:57:24 [DEBUG   ] Finished updating board flags in 1.499 seconds
2012-08-09 02:57:43 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2012-08-09 02:58:03 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-09 02:58:23 [DEBUG   ] Finished updating ant stats in 1.253 seconds
2012-08-09 02:58:24 [DEBUG   ] Finished updating board flags in 1.353 seconds
2012-08-09 02:58:43 [DEBUG   ] Finished updating ant stats in 1.151 seconds
2012-08-09 02:59:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 02:59:06 [DEBUG   ] Got command RPT from MCS: ref #8582
2012-08-09 02:59:06 [DEBUG   ] summary = NORMAL
2012-08-09 02:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8582  14 56148 10746337 A NORMALNORMAL'
2012-08-09 02:59:06 [DEBUG   ] Got command RPT from MCS: ref #8583
2012-08-09 02:59:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 02:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8583  48 56148 10746337 A NORMALSystem calibrated and operating normally'
2012-08-09 02:59:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 02:59:23 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2012-08-09 02:59:24 [DEBUG   ] Finished updating board flags in 1.316 seconds
2012-08-09 02:59:43 [DEBUG   ] Finished updating ant stats in 0.960 seconds
2012-08-09 03:00:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 03:00:23 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2012-08-09 03:00:24 [DEBUG   ] Finished updating board flags in 1.321 seconds
2012-08-09 03:00:43 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2012-08-09 03:01:03 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-09 03:01:23 [DEBUG   ] Finished updating ant stats in 0.445 seconds
2012-08-09 03:01:24 [DEBUG   ] Finished updating board flags in 1.301 seconds
2012-08-09 03:01:44 [DEBUG   ] Finished updating ant stats in 1.356 seconds
2012-08-09 03:02:04 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 03:02:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 03:02:24 [DEBUG   ] Finished updating ant stats in 1.017 seconds
2012-08-09 03:02:24 [DEBUG   ] Finished updating board flags in 1.349 seconds
2012-08-09 03:02:44 [DEBUG   ] Finished updating ant stats in 0.962 seconds
2012-08-09 03:03:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 03:03:24 [DEBUG   ] Finished updating ant stats in 0.853 seconds
2012-08-09 03:03:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 03:03:24 [DEBUG   ] Finished updating board flags in 1.459 seconds
2012-08-09 03:03:44 [DEBUG   ] Finished updating ant stats in 0.751 seconds
2012-08-09 03:04:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 03:04:06 [DEBUG   ] Got command RPT from MCS: ref #8599
2012-08-09 03:04:06 [DEBUG   ] summary = NORMAL
2012-08-09 03:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8599  14 56148 11046333 A NORMALNORMAL'
2012-08-09 03:04:06 [DEBUG   ] Got command RPT from MCS: ref #8600
2012-08-09 03:04:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 03:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8600  48 56148 11046333 A NORMALSystem calibrated and operating normally'
2012-08-09 03:04:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 03:04:24 [DEBUG   ] Finished updating ant stats in 0.650 seconds
2012-08-09 03:04:24 [DEBUG   ] Finished updating board flags in 1.414 seconds
2012-08-09 03:04:44 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2012-08-09 03:05:05 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2012-08-09 03:05:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 03:05:24 [DEBUG   ] Finished updating board flags in 1.426 seconds
2012-08-09 03:05:25 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-09 03:05:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 03:06:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 03:06:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 03:06:24 [DEBUG   ] Finished updating board flags in 1.312 seconds
2012-08-09 03:06:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 03:06:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 03:07:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 03:07:23 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 03:07:24 [DEBUG   ] Finished updating board flags in 1.281 seconds
2012-08-09 03:07:25 [DEBUG   ] Finished updating ant stats in 0.991 seconds
2012-08-09 03:07:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 03:08:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 03:08:25 [DEBUG   ] Finished updating board flags in 1.489 seconds
2012-08-09 03:08:25 [DEBUG   ] Finished updating ant stats in 0.817 seconds
2012-08-09 03:08:45 [DEBUG   ] Finished updating ant stats in 0.783 seconds
2012-08-09 03:09:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 03:09:06 [DEBUG   ] Got command RPT from MCS: ref #8616
2012-08-09 03:09:06 [DEBUG   ] summary = NORMAL
2012-08-09 03:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8616  14 56148 11346333 A NORMALNORMAL'
2012-08-09 03:09:06 [DEBUG   ] Got command RPT from MCS: ref #8617
2012-08-09 03:09:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 03:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8617  48 56148 11346333 A NORMALSystem calibrated and operating normally'
2012-08-09 03:09:25 [DEBUG   ] Finished updating board flags in 1.445 seconds
2012-08-09 03:09:25 [DEBUG   ] Finished updating ant stats in 0.638 seconds
2012-08-09 03:09:45 [DEBUG   ] Finished updating ant stats in 0.564 seconds
2012-08-09 03:10:06 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 03:10:25 [DEBUG   ] Finished updating board flags in 1.334 seconds
2012-08-09 03:10:26 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-09 03:10:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 03:11:06 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2012-08-09 03:11:25 [DEBUG   ] Finished updating board flags in 1.246 seconds
2012-08-09 03:11:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 03:11:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 03:12:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 03:12:25 [DEBUG   ] Finished updating board flags in 1.826 seconds
2012-08-09 03:12:26 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2012-08-09 03:12:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 03:13:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 03:13:25 [DEBUG   ] Finished updating board flags in 1.211 seconds
2012-08-09 03:13:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 03:13:46 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2012-08-09 03:14:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 03:14:06 [DEBUG   ] Got command RPT from MCS: ref #8633
2012-08-09 03:14:06 [DEBUG   ] summary = NORMAL
2012-08-09 03:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8633  14 56148 11646340 A NORMALNORMAL'
2012-08-09 03:14:06 [DEBUG   ] Got command RPT from MCS: ref #8634
2012-08-09 03:14:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 03:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8634  48 56148 11646341 A NORMALSystem calibrated and operating normally'
2012-08-09 03:14:25 [DEBUG   ] Finished updating board flags in 1.431 seconds
2012-08-09 03:14:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 03:14:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 03:15:06 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2012-08-09 03:15:25 [DEBUG   ] Finished updating board flags in 1.223 seconds
2012-08-09 03:15:26 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-09 03:15:47 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-09 03:16:07 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-09 03:16:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 03:16:25 [DEBUG   ] Finished updating board flags in 1.298 seconds
2012-08-09 03:16:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 03:16:47 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 03:17:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 03:17:25 [DEBUG   ] Finished updating board flags in 1.237 seconds
2012-08-09 03:17:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 03:17:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 03:18:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 03:18:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 03:18:25 [DEBUG   ] Finished updating board flags in 1.245 seconds
2012-08-09 03:18:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 03:18:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 03:19:06 [DEBUG   ] Got command RPT from MCS: ref #8650
2012-08-09 03:19:06 [DEBUG   ] summary = NORMAL
2012-08-09 03:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8650  14 56148 11946337 A NORMALNORMAL'
2012-08-09 03:19:06 [DEBUG   ] Got command RPT from MCS: ref #8651
2012-08-09 03:19:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 03:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8651  48 56148 11946337 A NORMALSystem calibrated and operating normally'
2012-08-09 03:19:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 03:19:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 03:19:25 [DEBUG   ] Finished updating board flags in 1.248 seconds
2012-08-09 03:19:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 03:19:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 03:20:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 03:20:25 [DEBUG   ] Finished updating board flags in 1.247 seconds
2012-08-09 03:20:27 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2012-08-09 03:20:48 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2012-08-09 03:21:08 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-09 03:21:25 [DEBUG   ] Finished updating board flags in 1.439 seconds
2012-08-09 03:21:28 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 03:21:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 03:22:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 03:22:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 03:22:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 03:22:25 [DEBUG   ] Finished updating board flags in 1.370 seconds
2012-08-09 03:22:28 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-09 03:22:48 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 03:23:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 03:23:25 [DEBUG   ] Finished updating board flags in 1.227 seconds
2012-08-09 03:23:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 03:23:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 03:24:06 [DEBUG   ] Got command RPT from MCS: ref #8667
2012-08-09 03:24:06 [DEBUG   ] summary = NORMAL
2012-08-09 03:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8667  14 56148 12246341 A NORMALNORMAL'
2012-08-09 03:24:06 [DEBUG   ] Got command RPT from MCS: ref #8668
2012-08-09 03:24:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 03:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8668  48 56148 12246341 A NORMALSystem calibrated and operating normally'
2012-08-09 03:24:08 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 03:24:25 [DEBUG   ] Finished updating board flags in 1.227 seconds
2012-08-09 03:24:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 03:24:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 03:25:09 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-09 03:25:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 03:25:25 [DEBUG   ] Finished updating board flags in 1.227 seconds
2012-08-09 03:25:29 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-09 03:25:49 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-09 03:26:09 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-09 03:26:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 03:26:25 [DEBUG   ] Finished updating board flags in 1.223 seconds
2012-08-09 03:26:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 03:26:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 03:27:09 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 03:27:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 03:27:25 [DEBUG   ] Finished updating board flags in 1.229 seconds
2012-08-09 03:27:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 03:27:49 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-09 03:28:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 03:28:25 [DEBUG   ] Finished updating board flags in 1.231 seconds
2012-08-09 03:28:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 03:28:49 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-09 03:29:06 [DEBUG   ] Got command RPT from MCS: ref #8684
2012-08-09 03:29:06 [DEBUG   ] summary = NORMAL
2012-08-09 03:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8684  14 56148 12546345 A NORMALNORMAL'
2012-08-09 03:29:06 [DEBUG   ] Got command RPT from MCS: ref #8685
2012-08-09 03:29:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 03:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8685  48 56148 12546345 A NORMALSystem calibrated and operating normally'
2012-08-09 03:29:09 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 03:29:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 03:29:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-09 03:29:26 [DEBUG   ] Finished updating board flags in 1.426 seconds
2012-08-09 03:29:29 [DEBUG   ] Finished updating ant stats in 0.793 seconds
2012-08-09 03:29:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 03:30:10 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-09 03:30:26 [DEBUG   ] Finished updating board flags in 1.427 seconds
2012-08-09 03:30:30 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 03:30:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 03:31:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 03:31:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 03:31:26 [DEBUG   ] Finished updating board flags in 1.383 seconds
2012-08-09 03:31:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 03:31:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 03:32:10 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 03:32:26 [DEBUG   ] Finished updating board flags in 1.259 seconds
2012-08-09 03:32:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 03:32:50 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 03:33:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 03:33:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 03:33:26 [DEBUG   ] Finished updating board flags in 1.256 seconds
2012-08-09 03:33:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 03:33:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 03:34:06 [DEBUG   ] Got command RPT from MCS: ref #8701
2012-08-09 03:34:06 [DEBUG   ] summary = NORMAL
2012-08-09 03:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8701  14 56148 12846349 A NORMALNORMAL'
2012-08-09 03:34:06 [DEBUG   ] Got command RPT from MCS: ref #8702
2012-08-09 03:34:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 03:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8702  48 56148 12846349 A NORMALSystem calibrated and operating normally'
2012-08-09 03:34:10 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 03:34:26 [DEBUG   ] Finished updating board flags in 1.257 seconds
2012-08-09 03:34:30 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2012-08-09 03:34:51 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 03:35:11 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2012-08-09 03:35:26 [DEBUG   ] Finished updating board flags in 1.259 seconds
2012-08-09 03:35:31 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 03:35:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 03:36:11 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-09 03:36:26 [DEBUG   ] Finished updating board flags in 1.273 seconds
2012-08-09 03:36:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 03:36:51 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2012-08-09 03:37:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 03:37:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 03:37:26 [DEBUG   ] Finished updating board flags in 1.259 seconds
2012-08-09 03:37:31 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 03:37:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 03:38:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 03:38:26 [DEBUG   ] Finished updating board flags in 1.258 seconds
2012-08-09 03:38:31 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2012-08-09 03:38:52 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-09 03:39:06 [DEBUG   ] Got command RPT from MCS: ref #8718
2012-08-09 03:39:06 [DEBUG   ] summary = NORMAL
2012-08-09 03:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8718  14 56148 13146341 A NORMALNORMAL'
2012-08-09 03:39:06 [DEBUG   ] Got command RPT from MCS: ref #8719
2012-08-09 03:39:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 03:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8719  48 56148 13146341 A NORMALSystem calibrated and operating normally'
2012-08-09 03:39:12 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-09 03:39:26 [DEBUG   ] Finished updating board flags in 1.448 seconds
2012-08-09 03:39:31 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-09 03:39:52 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2012-08-09 03:40:12 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 03:40:26 [DEBUG   ] Finished updating board flags in 1.412 seconds
2012-08-09 03:40:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 03:40:52 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 03:41:12 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 03:41:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 03:41:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 03:41:26 [DEBUG   ] Finished updating board flags in 1.338 seconds
2012-08-09 03:41:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 03:41:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 03:42:12 [DEBUG   ] Finished updating ant stats in 0.791 seconds
2012-08-09 03:42:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 03:42:26 [DEBUG   ] Finished updating board flags in 1.232 seconds
2012-08-09 03:42:32 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2012-08-09 03:42:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 03:43:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 03:43:26 [DEBUG   ] Finished updating board flags in 1.228 seconds
2012-08-09 03:43:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 03:43:52 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-09 03:44:06 [DEBUG   ] Got command RPT from MCS: ref #8735
2012-08-09 03:44:06 [DEBUG   ] summary = NORMAL
2012-08-09 03:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8735  14 56148 13446345 A NORMALNORMAL'
2012-08-09 03:44:06 [DEBUG   ] Got command RPT from MCS: ref #8736
2012-08-09 03:44:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 03:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8736  48 56148 13446345 A NORMALSystem calibrated and operating normally'
2012-08-09 03:44:13 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2012-08-09 03:44:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 03:44:26 [DEBUG   ] Finished updating board flags in 1.242 seconds
2012-08-09 03:44:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 03:44:53 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-09 03:45:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 03:45:26 [DEBUG   ] Finished updating board flags in 1.234 seconds
2012-08-09 03:45:33 [DEBUG   ] Finished updating ant stats in 1.192 seconds
2012-08-09 03:45:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 03:46:13 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 03:46:26 [DEBUG   ] Finished updating board flags in 1.241 seconds
2012-08-09 03:46:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 03:46:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 03:47:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 03:47:27 [DEBUG   ] Finished updating board flags in 1.506 seconds
2012-08-09 03:47:33 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 03:47:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 03:48:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 03:48:27 [DEBUG   ] Finished updating board flags in 1.412 seconds
2012-08-09 03:48:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 03:48:53 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-09 03:49:06 [DEBUG   ] Got command RPT from MCS: ref #8752
2012-08-09 03:49:06 [DEBUG   ] summary = NORMAL
2012-08-09 03:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8752  14 56148 13746341 A NORMALNORMAL'
2012-08-09 03:49:06 [DEBUG   ] Got command RPT from MCS: ref #8753
2012-08-09 03:49:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 03:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8753  48 56148 13746341 A NORMALSystem calibrated and operating normally'
2012-08-09 03:49:14 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 03:49:27 [DEBUG   ] Finished updating board flags in 1.319 seconds
2012-08-09 03:49:34 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-09 03:49:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 03:50:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 03:50:27 [DEBUG   ] Finished updating board flags in 1.237 seconds
2012-08-09 03:50:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 03:50:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 03:51:14 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2012-08-09 03:51:27 [DEBUG   ] Finished updating board flags in 1.245 seconds
2012-08-09 03:51:34 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2012-08-09 03:51:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 03:52:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 03:52:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 03:52:27 [DEBUG   ] Finished updating board flags in 1.237 seconds
2012-08-09 03:52:34 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 03:52:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 03:53:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 03:53:27 [DEBUG   ] Finished updating board flags in 1.262 seconds
2012-08-09 03:53:35 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2012-08-09 03:53:55 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-09 03:54:06 [DEBUG   ] Got command RPT from MCS: ref #8769
2012-08-09 03:54:06 [DEBUG   ] summary = NORMAL
2012-08-09 03:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8769  14 56148 14046353 A NORMALNORMAL'
2012-08-09 03:54:06 [DEBUG   ] Got command RPT from MCS: ref #8770
2012-08-09 03:54:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 03:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8770  48 56148 14046353 A NORMALSystem calibrated and operating normally'
2012-08-09 03:54:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 03:54:27 [DEBUG   ] Finished updating board flags in 1.260 seconds
2012-08-09 03:54:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 03:54:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 03:55:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 03:55:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 03:55:27 [DEBUG   ] Finished updating board flags in 1.313 seconds
2012-08-09 03:55:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 03:55:55 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-09 03:56:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 03:56:27 [DEBUG   ] Finished updating board flags in 1.473 seconds
2012-08-09 03:56:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 03:56:55 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 03:57:15 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 03:57:27 [DEBUG   ] Finished updating board flags in 1.286 seconds
2012-08-09 03:57:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 03:57:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 03:58:15 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-09 03:58:27 [DEBUG   ] Finished updating board flags in 1.231 seconds
2012-08-09 03:58:36 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2012-08-09 03:58:55 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-09 03:59:06 [DEBUG   ] Got command RPT from MCS: ref #8786
2012-08-09 03:59:06 [DEBUG   ] summary = NORMAL
2012-08-09 03:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8786  14 56148 14346348 A NORMALNORMAL'
2012-08-09 03:59:06 [DEBUG   ] Got command RPT from MCS: ref #8787
2012-08-09 03:59:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 03:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8787  48 56148 14346349 A NORMALSystem calibrated and operating normally'
2012-08-09 03:59:16 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 03:59:27 [DEBUG   ] Finished updating board flags in 1.251 seconds
2012-08-09 03:59:36 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2012-08-09 03:59:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 04:00:16 [DEBUG   ] Finished updating ant stats in 1.192 seconds
2012-08-09 04:00:27 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 04:00:27 [DEBUG   ] Finished updating board flags in 1.256 seconds
2012-08-09 04:00:36 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 04:00:56 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2012-08-09 04:01:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 04:01:27 [DEBUG   ] Finished updating board flags in 1.253 seconds
2012-08-09 04:01:36 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2012-08-09 04:01:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 04:02:16 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-09 04:02:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 04:02:28 [DEBUG   ] Finished updating board flags in 1.435 seconds
2012-08-09 04:02:37 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2012-08-09 04:02:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 04:03:17 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 04:03:28 [DEBUG   ] Finished updating board flags in 1.389 seconds
2012-08-09 04:03:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 04:03:57 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 04:04:06 [DEBUG   ] Got command RPT from MCS: ref #8803
2012-08-09 04:04:06 [DEBUG   ] summary = NORMAL
2012-08-09 04:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8803  14 56148 14646353 A NORMALNORMAL'
2012-08-09 04:04:06 [DEBUG   ] Got command RPT from MCS: ref #8804
2012-08-09 04:04:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 04:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8804  48 56148 14646353 A NORMALSystem calibrated and operating normally'
2012-08-09 04:04:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 04:04:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 04:04:28 [DEBUG   ] Finished updating board flags in 1.281 seconds
2012-08-09 04:04:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 04:04:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 04:05:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 04:05:28 [DEBUG   ] Finished updating board flags in 1.285 seconds
2012-08-09 04:05:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 04:05:57 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 04:06:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 04:06:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 04:06:28 [DEBUG   ] Finished updating board flags in 1.283 seconds
2012-08-09 04:06:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 04:06:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 04:07:17 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-09 04:07:28 [DEBUG   ] Finished updating board flags in 1.280 seconds
2012-08-09 04:07:38 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2012-08-09 04:07:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 04:08:18 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 04:08:28 [DEBUG   ] Finished updating board flags in 1.288 seconds
2012-08-09 04:08:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 04:08:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 04:09:06 [DEBUG   ] Got command RPT from MCS: ref #8820
2012-08-09 04:09:06 [DEBUG   ] summary = NORMAL
2012-08-09 04:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8820  14 56148 14946349 A NORMALNORMAL'
2012-08-09 04:09:06 [DEBUG   ] Got command RPT from MCS: ref #8821
2012-08-09 04:09:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 04:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8821  48 56148 14946349 A NORMALSystem calibrated and operating normally'
2012-08-09 04:09:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 04:09:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 04:09:28 [DEBUG   ] Finished updating board flags in 1.465 seconds
2012-08-09 04:09:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 04:09:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 04:10:18 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2012-08-09 04:10:28 [DEBUG   ] Finished updating board flags in 1.324 seconds
2012-08-09 04:10:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 04:10:58 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 04:11:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 04:11:28 [DEBUG   ] Finished updating board flags in 1.231 seconds
2012-08-09 04:11:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 04:11:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 04:12:18 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 04:12:28 [DEBUG   ] Finished updating board flags in 1.229 seconds
2012-08-09 04:12:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 04:12:58 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 04:13:18 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-09 04:13:28 [DEBUG   ] Finished updating board flags in 1.228 seconds
2012-08-09 04:13:39 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2012-08-09 04:13:59 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-09 04:14:06 [DEBUG   ] Got command RPT from MCS: ref #8837
2012-08-09 04:14:06 [DEBUG   ] summary = NORMAL
2012-08-09 04:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8837  14 56148 15246357 A NORMALNORMAL'
2012-08-09 04:14:06 [DEBUG   ] Got command RPT from MCS: ref #8838
2012-08-09 04:14:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 04:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8838  48 56148 15246357 A NORMALSystem calibrated and operating normally'
2012-08-09 04:14:19 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 04:14:28 [DEBUG   ] Finished updating board flags in 1.230 seconds
2012-08-09 04:14:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 04:14:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 04:15:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 04:15:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 04:15:28 [DEBUG   ] Finished updating board flags in 1.249 seconds
2012-08-09 04:15:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 04:15:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 04:16:19 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 04:16:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 04:16:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 04:16:29 [DEBUG   ] Finished updating board flags in 1.448 seconds
2012-08-09 04:16:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 04:16:59 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 04:17:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 04:17:29 [DEBUG   ] Finished updating board flags in 1.416 seconds
2012-08-09 04:17:39 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 04:17:59 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 04:18:20 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-09 04:18:29 [DEBUG   ] Finished updating board flags in 1.380 seconds
2012-08-09 04:18:40 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2012-08-09 04:19:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 04:19:06 [DEBUG   ] Got command RPT from MCS: ref #8854
2012-08-09 04:19:06 [DEBUG   ] summary = NORMAL
2012-08-09 04:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8854  14 56148 15546352 A NORMALNORMAL'
2012-08-09 04:19:06 [DEBUG   ] Got command RPT from MCS: ref #8855
2012-08-09 04:19:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 04:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8855  48 56148 15546353 A NORMALSystem calibrated and operating normally'
2012-08-09 04:19:20 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 04:19:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 04:19:29 [DEBUG   ] Finished updating board flags in 1.244 seconds
2012-08-09 04:19:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 04:20:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 04:20:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 04:20:29 [DEBUG   ] Finished updating board flags in 1.259 seconds
2012-08-09 04:20:40 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-09 04:21:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 04:21:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 04:21:29 [DEBUG   ] Finished updating board flags in 1.256 seconds
2012-08-09 04:21:40 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2012-08-09 04:22:00 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 04:22:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 04:22:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 04:22:29 [DEBUG   ] Finished updating board flags in 1.261 seconds
2012-08-09 04:22:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 04:23:00 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 04:23:20 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 04:23:29 [DEBUG   ] Finished updating board flags in 1.262 seconds
2012-08-09 04:23:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 04:24:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 04:24:06 [DEBUG   ] Got command RPT from MCS: ref #8871
2012-08-09 04:24:06 [DEBUG   ] summary = NORMAL
2012-08-09 04:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8871  14 56148 15846353 A NORMALNORMAL'
2012-08-09 04:24:06 [DEBUG   ] Got command RPT from MCS: ref #8872
2012-08-09 04:24:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 04:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8872  48 56148 15846353 A NORMALSystem calibrated and operating normally'
2012-08-09 04:24:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 04:24:29 [DEBUG   ] Finished updating board flags in 1.360 seconds
2012-08-09 04:24:40 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-09 04:25:01 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2012-08-09 04:25:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 04:25:29 [DEBUG   ] Finished updating board flags in 1.538 seconds
2012-08-09 04:25:41 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-09 04:26:01 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2012-08-09 04:26:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 04:26:29 [DEBUG   ] Finished updating board flags in 1.248 seconds
2012-08-09 04:26:41 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 04:27:01 [DEBUG   ] Finished updating ant stats in 0.807 seconds
2012-08-09 04:27:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 04:27:29 [DEBUG   ] Finished updating board flags in 1.227 seconds
2012-08-09 04:27:41 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2012-08-09 04:28:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 04:28:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 04:28:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 04:28:29 [DEBUG   ] Finished updating board flags in 1.225 seconds
2012-08-09 04:28:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 04:29:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 04:29:06 [DEBUG   ] Got command RPT from MCS: ref #8888
2012-08-09 04:29:06 [DEBUG   ] summary = NORMAL
2012-08-09 04:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8888  14 56148 16146349 A NORMALNORMAL'
2012-08-09 04:29:06 [DEBUG   ] Got command RPT from MCS: ref #8889
2012-08-09 04:29:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 04:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8889  48 56148 16146349 A NORMALSystem calibrated and operating normally'
2012-08-09 04:29:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 04:29:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 04:29:29 [DEBUG   ] Finished updating board flags in 1.262 seconds
2012-08-09 04:29:42 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-09 04:30:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 04:30:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 04:30:29 [DEBUG   ] Finished updating board flags in 1.260 seconds
2012-08-09 04:30:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 04:31:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 04:31:22 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 04:31:30 [DEBUG   ] Finished updating board flags in 1.459 seconds
2012-08-09 04:31:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 04:32:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 04:32:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 04:32:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 04:32:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 04:32:30 [DEBUG   ] Finished updating board flags in 1.371 seconds
2012-08-09 04:32:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 04:33:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 04:33:22 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2012-08-09 04:33:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 04:33:30 [DEBUG   ] Finished updating board flags in 1.253 seconds
2012-08-09 04:33:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 04:34:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 04:34:06 [DEBUG   ] Got command RPT from MCS: ref #8905
2012-08-09 04:34:06 [DEBUG   ] summary = NORMAL
2012-08-09 04:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8905  14 56148 16446357 A NORMALNORMAL'
2012-08-09 04:34:06 [DEBUG   ] Got command RPT from MCS: ref #8906
2012-08-09 04:34:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 04:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8906  48 56148 16446357 A NORMALSystem calibrated and operating normally'
2012-08-09 04:34:23 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2012-08-09 04:34:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 04:34:30 [DEBUG   ] Finished updating board flags in 1.805 seconds
2012-08-09 04:34:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 04:35:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 04:35:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 04:35:30 [DEBUG   ] Finished updating board flags in 1.189 seconds
2012-08-09 04:35:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 04:36:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 04:36:23 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 04:36:30 [DEBUG   ] Finished updating board flags in 1.710 seconds
2012-08-09 04:36:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 04:37:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 04:37:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 04:37:30 [DEBUG   ] Finished updating board flags in 1.285 seconds
2012-08-09 04:37:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 04:38:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 04:38:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 04:38:30 [DEBUG   ] Finished updating board flags in 1.473 seconds
2012-08-09 04:38:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 04:39:03 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 04:39:06 [DEBUG   ] Got command RPT from MCS: ref #8922
2012-08-09 04:39:06 [DEBUG   ] summary = NORMAL
2012-08-09 04:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8922  14 56148 16746357 A NORMALNORMAL'
2012-08-09 04:39:06 [DEBUG   ] Got command RPT from MCS: ref #8923
2012-08-09 04:39:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 04:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8923  48 56148 16746357 A NORMALSystem calibrated and operating normally'
2012-08-09 04:39:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 04:39:30 [DEBUG   ] Finished updating board flags in 1.385 seconds
2012-08-09 04:39:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 04:40:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 04:40:23 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2012-08-09 04:40:30 [DEBUG   ] Finished updating board flags in 1.311 seconds
2012-08-09 04:40:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 04:41:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 04:41:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 04:41:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 04:41:31 [DEBUG   ] Finished updating board flags in 1.495 seconds
2012-08-09 04:41:43 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 04:42:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 04:42:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 04:42:31 [DEBUG   ] Finished updating board flags in 1.315 seconds
2012-08-09 04:42:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 04:43:03 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 04:43:24 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-09 04:43:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 04:43:31 [DEBUG   ] Finished updating board flags in 1.237 seconds
2012-08-09 04:43:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 04:44:04 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 04:44:06 [DEBUG   ] Got command RPT from MCS: ref #8939
2012-08-09 04:44:06 [DEBUG   ] summary = NORMAL
2012-08-09 04:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8939  14 56148 17046360 A NORMALNORMAL'
2012-08-09 04:44:06 [DEBUG   ] Got command RPT from MCS: ref #8940
2012-08-09 04:44:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 04:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8940  48 56148 17046361 A NORMALSystem calibrated and operating normally'
2012-08-09 04:44:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 04:44:31 [DEBUG   ] Finished updating board flags in 1.235 seconds
2012-08-09 04:44:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 04:45:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 04:45:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 04:45:31 [DEBUG   ] Finished updating board flags in 1.310 seconds
2012-08-09 04:45:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 04:46:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 04:46:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 04:46:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 04:46:31 [DEBUG   ] Finished updating board flags in 1.312 seconds
2012-08-09 04:46:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 04:47:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 04:47:19 [DEBUG   ] Got command INI from MCS: ref #8956
2012-08-09 04:47:19 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2012-08-09 04:47:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI     8956   8 56148 17239721 ABOOTING'
2012-08-09 04:47:24 [WARNING ] AntennaStats: no access to lwa28
2012-08-09 04:47:24 [WARNING ] AntennaStats: last command was /usr/local/bin/lwa28 /lwa/software/amplitude
2012-08-09 04:47:24 [WARNING ] AntennaStats: last command output as 
2012-08-09 04:47:24 [DEBUG   ] Finished updating ant stats in 0.687 seconds
2012-08-09 04:47:39 [INFO    ] -------------------
2012-08-09 04:47:39 [INFO    ]  LWA board status
2012-08-09 04:47:39 [INFO    ] -------------------
2012-08-09 04:47:39 [INFO    ] DP 1: 2 lwa27
2012-08-09 04:47:39 [INFO    ] DP 1: 3 lwa24
2012-08-09 04:47:39 [INFO    ] DP 1: 4 lwa23
2012-08-09 04:47:39 [INFO    ] DP 1: 5 lwa18
2012-08-09 04:47:39 [INFO    ] DP 1: 6 lwa10
2012-08-09 04:47:39 [INFO    ] DP 1: 7 lwa32
2012-08-09 04:47:39 [INFO    ] DP 1: 8 lwa11
2012-08-09 04:47:39 [INFO    ] DP 1: 9 lwa30
2012-08-09 04:47:39 [INFO    ] DP 1: 10 lwa12
2012-08-09 04:47:39 [INFO    ] DP 1: 11 lwa8
2012-08-09 04:47:39 [INFO    ] DP 1: 12 lwa13
2012-08-09 04:47:39 [INFO    ] DP 1: 13 lwa26
2012-08-09 04:47:39 [INFO    ] DP 1: 14 lwa14
2012-08-09 04:47:39 [INFO    ] DP 1: 16 lwa22
2012-08-09 04:47:39 [INFO    ] DP 1: 17 lwa20
2012-08-09 04:47:39 [INFO    ] DP 1: 18 lwa1
2012-08-09 04:47:39 [INFO    ] DP 1: 19 lwa5
2012-08-09 04:47:39 [INFO    ] DP 1: 20 lwa25
2012-08-09 04:47:39 [INFO    ] DP 1: 21 lwa35
2012-08-09 04:47:39 [INFO    ] DP 1: 22 lwa19
2012-08-09 04:47:39 [INFO    ] DP 1: 23 lwa21
2012-08-09 04:47:39 [INFO    ] DP 1: 24 lwa6
2012-08-09 04:47:39 [INFO    ] DP 1: 25 lwa7
2012-08-09 04:47:39 [INFO    ] DP 1: 26 lwa33
2012-08-09 04:47:39 [INFO    ] DP 1: 27 lwa15
2012-08-09 04:47:39 [INFO    ] DP 1: 28 lwa28
2012-08-09 04:47:39 [INFO    ] DP 2: 1 lwa16
2012-08-09 04:47:39 [INFO    ] DP 2: 15 lwa34
2012-08-09 04:47:39 [INFO    ] Total of 28 boards
2012-08-09 04:47:39 [INFO    ] Total of 260 stands
2012-08-09 04:47:39 [INFO    ] -------------------
2012-08-09 04:47:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30357
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30358
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30359
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30360
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30361
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30362
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30363
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30364
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30365
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30366
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30367
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30368
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30369
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30370
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30371
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30372
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30373
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30374
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30375
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30376
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30377
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30378
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30379
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30380
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30381
2012-08-09 04:47:46 [DEBUG   ] 2012-08-09 04:47:46 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 30382
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:58 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30357 exited with status 0
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30358 exited with status 0
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30359 exited with status 0
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30360 exited with status 0
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30361 exited with status 0
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30362 exited with status 0
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30363 exited with status 0
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30364 exited with status 0
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30365 exited with status 0
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30366 exited with status 0
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30367 exited with status 0
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30368 exited with status 0
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30369 exited with status 0
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30370 exited with status 0
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30371 exited with status 0
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30372 exited with status 0
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30373 exited with status 0
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30374 exited with status 0
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30375 exited with status 0
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30376 exited with status 0
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30377 exited with status 0
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30378 exited with status 0
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30379 exited with status 0
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30380 exited with status 0
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30381 exited with status 0
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 30382 exited with status 0
2012-08-09 04:47:59 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] spawn_process: at 2012-08-09 04:47:59 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 30409
2012-08-09 04:47:59 [DEBUG   ] 2012-08-09 04:47:59 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 30410
2012-08-09 04:48:05 [DEBUG   ] 2012-08-09 04:48:05 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 30409 exited with status 0
2012-08-09 04:48:05 [DEBUG   ] 2012-08-09 04:48:05 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 30410 exited with status 0
2012-08-09 04:48:05 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2012-08-09 04:48:05 [DEBUG   ] spawn_process: at 2012-08-09 04:48:05 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2012-08-09 04:48:05 [DEBUG   ] spawn_process: at 2012-08-09 04:48:05 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2012-08-09 04:48:05 [INFO    ] Setting Beam 1 xbars
2012-08-09 04:48:05 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2012-08-09 04:48:05 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2012-08-09 04:48:05 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2012-08-09 04:48:05 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2012-08-09 04:48:05 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2012-08-09 04:48:05 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2012-08-09 04:48:05 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2012-08-09 04:48:06 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2012-08-09 04:48:06 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2012-08-09 04:48:06 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2012-08-09 04:48:06 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2012-08-09 04:48:06 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2012-08-09 04:48:06 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2012-08-09 04:48:06 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2012-08-09 04:48:06 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2012-08-09 04:48:06 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2012-08-09 04:48:06 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2012-08-09 04:48:07 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2012-08-09 04:48:07 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2012-08-09 04:48:07 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2012-08-09 04:48:07 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2012-08-09 04:48:07 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2012-08-09 04:48:07 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2012-08-09 04:48:07 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2012-08-09 04:48:07 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2012-08-09 04:48:07 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2012-08-09 04:48:08 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2012-08-09 04:48:08 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2012-08-09 04:48:08 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2012-08-09 04:48:08 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2012-08-09 04:48:08 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2012-08-09 04:48:08 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2012-08-09 04:48:08 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2012-08-09 04:48:08 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2012-08-09 04:48:08 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2012-08-09 04:48:09 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2012-08-09 04:48:09 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2012-08-09 04:48:09 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2012-08-09 04:48:09 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2012-08-09 04:48:09 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2012-08-09 04:48:09 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2012-08-09 04:48:09 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2012-08-09 04:48:09 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2012-08-09 04:48:09 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2012-08-09 04:48:10 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2012-08-09 04:48:10 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2012-08-09 04:48:10 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2012-08-09 04:48:10 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2012-08-09 04:48:10 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2012-08-09 04:48:10 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2012-08-09 04:48:10 [INFO    ] Setting Beam 2 xbars
2012-08-09 04:48:10 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2012-08-09 04:48:10 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2012-08-09 04:48:10 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2012-08-09 04:48:11 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2012-08-09 04:48:11 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2012-08-09 04:48:11 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2012-08-09 04:48:11 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2012-08-09 04:48:11 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2012-08-09 04:48:11 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2012-08-09 04:48:11 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2012-08-09 04:48:11 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2012-08-09 04:48:11 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2012-08-09 04:48:12 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2012-08-09 04:48:12 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2012-08-09 04:48:12 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2012-08-09 04:48:12 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2012-08-09 04:48:12 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2012-08-09 04:48:12 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2012-08-09 04:48:12 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2012-08-09 04:48:12 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2012-08-09 04:48:12 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2012-08-09 04:48:13 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2012-08-09 04:48:13 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2012-08-09 04:48:13 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2012-08-09 04:48:13 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2012-08-09 04:48:13 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2012-08-09 04:48:13 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2012-08-09 04:48:13 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2012-08-09 04:48:13 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2012-08-09 04:48:13 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2012-08-09 04:48:14 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2012-08-09 04:48:14 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2012-08-09 04:48:14 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2012-08-09 04:48:14 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2012-08-09 04:48:14 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2012-08-09 04:48:14 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2012-08-09 04:48:14 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2012-08-09 04:48:14 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2012-08-09 04:48:14 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2012-08-09 04:48:14 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2012-08-09 04:48:15 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2012-08-09 04:48:15 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2012-08-09 04:48:15 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2012-08-09 04:48:15 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2012-08-09 04:48:15 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2012-08-09 04:48:15 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2012-08-09 04:48:15 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2012-08-09 04:48:15 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2012-08-09 04:48:15 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2012-08-09 04:48:16 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2012-08-09 04:48:16 [INFO    ] Setting Beam 3 xbars
2012-08-09 04:48:16 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2012-08-09 04:48:16 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2012-08-09 04:48:16 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2012-08-09 04:48:16 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2012-08-09 04:48:16 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2012-08-09 04:48:16 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2012-08-09 04:48:16 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2012-08-09 04:48:16 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2012-08-09 04:48:17 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2012-08-09 04:48:17 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2012-08-09 04:48:17 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2012-08-09 04:48:17 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2012-08-09 04:48:17 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2012-08-09 04:48:17 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2012-08-09 04:48:17 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2012-08-09 04:48:17 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2012-08-09 04:48:17 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2012-08-09 04:48:18 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2012-08-09 04:48:18 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2012-08-09 04:48:18 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2012-08-09 04:48:18 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2012-08-09 04:48:18 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2012-08-09 04:48:18 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2012-08-09 04:48:18 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2012-08-09 04:48:18 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2012-08-09 04:48:18 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2012-08-09 04:48:18 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2012-08-09 04:48:19 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2012-08-09 04:48:19 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2012-08-09 04:48:19 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2012-08-09 04:48:19 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2012-08-09 04:48:19 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2012-08-09 04:48:19 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2012-08-09 04:48:19 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2012-08-09 04:48:19 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2012-08-09 04:48:19 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2012-08-09 04:48:20 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2012-08-09 04:48:20 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2012-08-09 04:48:20 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2012-08-09 04:48:20 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2012-08-09 04:48:20 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2012-08-09 04:48:20 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2012-08-09 04:48:20 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2012-08-09 04:48:20 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2012-08-09 04:48:20 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2012-08-09 04:48:21 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2012-08-09 04:48:21 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2012-08-09 04:48:21 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2012-08-09 04:48:21 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2012-08-09 04:48:21 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2012-08-09 04:48:21 [INFO    ] Setting Beam 4 xbars
2012-08-09 04:48:21 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2012-08-09 04:48:21 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-09 04:48:21 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-09 04:48:21 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-09 04:48:22 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-09 04:48:22 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2012-08-09 04:48:22 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2012-08-09 04:48:22 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2012-08-09 04:48:22 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2012-08-09 04:48:22 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2012-08-09 04:48:22 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2012-08-09 04:48:22 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2012-08-09 04:48:22 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2012-08-09 04:48:23 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2012-08-09 04:48:23 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2012-08-09 04:48:23 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2012-08-09 04:48:23 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2012-08-09 04:48:23 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2012-08-09 04:48:23 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2012-08-09 04:48:23 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2012-08-09 04:48:23 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2012-08-09 04:48:23 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2012-08-09 04:48:24 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2012-08-09 04:48:24 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2012-08-09 04:48:24 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2012-08-09 04:48:24 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2012-08-09 04:48:24 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2012-08-09 04:48:24 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2012-08-09 04:48:24 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2012-08-09 04:48:24 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2012-08-09 04:48:24 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2012-08-09 04:48:25 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2012-08-09 04:48:25 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2012-08-09 04:48:25 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2012-08-09 04:48:25 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2012-08-09 04:48:25 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2012-08-09 04:48:25 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2012-08-09 04:48:25 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2012-08-09 04:48:25 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2012-08-09 04:48:25 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2012-08-09 04:48:26 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2012-08-09 04:48:26 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2012-08-09 04:48:26 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2012-08-09 04:48:26 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2012-08-09 04:48:26 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2012-08-09 04:48:26 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2012-08-09 04:48:26 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2012-08-09 04:48:26 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2012-08-09 04:48:26 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2012-08-09 04:48:26 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2012-08-09 04:48:27 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2012-08-09 04:48:27 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2012-08-09 04:48:27 [INFO    ] All xbars set
2012-08-09 04:48:27 [INFO    ] Setting adder chain routing for all beams
2012-08-09 04:48:32 [INFO    ] Setting beam ids
2012-08-09 04:48:42 [INFO    ] Starting beam delay calibration
2012-08-09 04:48:50 [DEBUG   ] Got command RPT from MCS: ref #8957
2012-08-09 04:48:50 [DEBUG   ] summary = BOOTING
2012-08-09 04:48:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8957  15 56148 17330469 ABOOTINGBOOTING'
2012-08-09 04:48:54 [INFO    ] Beam 1 latency is 5728
2012-08-09 04:48:54 [INFO    ] Beam 2 latency is 5757
2012-08-09 04:48:54 [INFO    ] Beam 3 latency is 5738
2012-08-09 04:48:54 [INFO    ] Beam 4 latency is 5701
2012-08-09 04:48:54 [INFO    ] Stop calibration
2012-08-09 04:49:02 [INFO    ] Beam delay calibration successful
2012-08-09 04:49:02 [INFO    ] Calibration passed
2012-08-09 04:49:02 [DEBUG   ] spawn_process: at 2012-08-09 04:49:02 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2012-08-09 04:49:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2012-08-09 04:49:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2012-08-09 04:49:02 [DEBUG   ] spawn_process: at 2012-08-09 04:49:02 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2012-08-09 04:49:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2012-08-09 04:49:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2012-08-09 04:49:02 [DEBUG   ] spawn_process: at 2012-08-09 04:49:02 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2012-08-09 04:49:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2012-08-09 04:49:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2012-08-09 04:49:02 [DEBUG   ] spawn_process: at 2012-08-09 04:49:02 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2012-08-09 04:49:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2012-08-09 04:49:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2012-08-09 04:49:03 [DEBUG   ] Finished updating ant stats in 0.888 seconds
2012-08-09 04:49:03 [INFO    ] Started antennas statistics background thread
2012-08-09 04:49:03 [INFO    ] Started board flags background thread
2012-08-09 04:49:03 [INFO    ] Started BAM background thread
2012-08-09 04:49:03 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 with PID 32005
2012-08-09 04:49:03 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 with PID 32008
2012-08-09 04:49:03 [INFO    ] Finished the INI process in 103.875 s
2012-08-09 04:49:04 [DEBUG   ] Finished updating board flags in 0.818 seconds
2012-08-09 04:49:06 [DEBUG   ] Got command RPT from MCS: ref #8958
2012-08-09 04:49:06 [DEBUG   ] summary = NORMAL
2012-08-09 04:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8958  14 56148 17346352 A NORMALNORMAL'
2012-08-09 04:49:06 [DEBUG   ] Got command RPT from MCS: ref #8959
2012-08-09 04:49:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 04:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8959  48 56148 17346353 A NORMALSystem calibrated and operating normally'
2012-08-09 04:49:23 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 04:49:33 [DEBUG   ] Got command RPT from MCS: ref #8975
2012-08-09 04:49:33 [DEBUG   ] summary = NORMAL
2012-08-09 04:49:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8975  14 56148 17373385 A NORMALNORMAL'
2012-08-09 04:49:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 04:50:03 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 04:50:04 [DEBUG   ] Finished updating board flags in 0.943 seconds
2012-08-09 04:50:23 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-09 04:50:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 04:51:04 [DEBUG   ] Finished updating ant stats in 1.227 seconds
2012-08-09 04:51:04 [DEBUG   ] Finished updating board flags in 0.889 seconds
2012-08-09 04:51:18 [DEBUG   ] Got command DRX from MCS: ref #8980
2012-08-09 04:51:18 [INFO    ] sending drx command to lwa34
2012-08-09 04:51:18 [DEBUG   ] run_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa34', '/lwa/software/drx 5 1 37900000.0 7 8 0']
2012-08-09 04:51:18 [DEBUG   ] drx = exited with status True, code 0x00
2012-08-09 04:51:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     8980   8 56148 17478365 A NORMAL'
2012-08-09 04:51:18 [DEBUG   ] Got command DRX from MCS: ref #8981
2012-08-09 04:51:18 [INFO    ] sending drx command to lwa34
2012-08-09 04:51:18 [DEBUG   ] run_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa34', '/lwa/software/drx 5 2 74030000.0 7 8 0']
2012-08-09 04:51:18 [DEBUG   ] drx = exited with status True, code 0x00
2012-08-09 04:51:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     8981   8 56148 17478369 A NORMAL'
2012-08-09 04:51:18 [DEBUG   ] Got command BAM from MCS: ref #8982
2012-08-09 04:51:18 [INFO    ] Finished processing BAM request
2012-08-09 04:51:18 [DEBUG   ] bam = exited with status True, code 0x00
2012-08-09 04:51:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     8982   8 56148 17478373 A NORMAL'
2012-08-09 04:51:18 [DEBUG   ] Got command DRX from MCS: ref #8983
2012-08-09 04:51:18 [INFO    ] sending drx command to lwa34
2012-08-09 04:51:18 [DEBUG   ] run_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 37900000.0 7 8 0']
2012-08-09 04:51:18 [DEBUG   ] drx = exited with status True, code 0x00
2012-08-09 04:51:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     8983   8 56148 17478377 A NORMAL'
2012-08-09 04:51:18 [DEBUG   ] Got command DRX from MCS: ref #8984
2012-08-09 04:51:18 [INFO    ] sending drx command to lwa34
2012-08-09 04:51:18 [DEBUG   ] run_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 74030000.0 7 8 0']
2012-08-09 04:51:18 [DEBUG   ] drx = exited with status True, code 0x00
2012-08-09 04:51:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     8984   8 56148 17478381 A NORMAL'
2012-08-09 04:51:18 [DEBUG   ] Got command BAM from MCS: ref #8985
2012-08-09 04:51:18 [INFO    ] Finished processing BAM request
2012-08-09 04:51:18 [DEBUG   ] bam = exited with status True, code 0x00
2012-08-09 04:51:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     8985   8 56148 17478385 A NORMAL'
2012-08-09 04:51:18 [DEBUG   ] Got command DRX from MCS: ref #8986
2012-08-09 04:51:18 [INFO    ] sending drx command to lwa16
2012-08-09 04:51:18 [DEBUG   ] run_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 37900000.0 7 8 0']
2012-08-09 04:51:18 [DEBUG   ] drx = exited with status True, code 0x00
2012-08-09 04:51:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     8986   8 56148 17478389 A NORMAL'
2012-08-09 04:51:18 [DEBUG   ] Got command DRX from MCS: ref #8987
2012-08-09 04:51:18 [INFO    ] sending drx command to lwa16
2012-08-09 04:51:18 [DEBUG   ] run_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 74030000.0 7 8 0']
2012-08-09 04:51:18 [DEBUG   ] drx = exited with status True, code 0x00
2012-08-09 04:51:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     8987   8 56148 17478393 A NORMAL'
2012-08-09 04:51:18 [DEBUG   ] Got command BAM from MCS: ref #8988
2012-08-09 04:51:18 [INFO    ] Finished processing BAM request
2012-08-09 04:51:18 [DEBUG   ] bam = exited with status True, code 0x00
2012-08-09 04:51:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     8988   8 56148 17478397 A NORMAL'
2012-08-09 04:51:18 [DEBUG   ] Got command DRX from MCS: ref #8989
2012-08-09 04:51:18 [INFO    ] sending drx command to lwa16
2012-08-09 04:51:18 [DEBUG   ] run_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 1 37900000.0 7 8 0']
2012-08-09 04:51:18 [DEBUG   ] drx = exited with status True, code 0x00
2012-08-09 04:51:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     8989   8 56148 17478401 A NORMAL'
2012-08-09 04:51:18 [DEBUG   ] Got command DRX from MCS: ref #8990
2012-08-09 04:51:18 [INFO    ] sending drx command to lwa16
2012-08-09 04:51:18 [DEBUG   ] run_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 2 74030000.0 7 8 0']
2012-08-09 04:51:18 [DEBUG   ] drx = exited with status True, code 0x00
2012-08-09 04:51:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX     8990   8 56148 17478405 A NORMAL'
2012-08-09 04:51:18 [DEBUG   ] Got command BAM from MCS: ref #8991
2012-08-09 04:51:18 [INFO    ] Finished processing BAM request
2012-08-09 04:51:18 [DEBUG   ] bam = exited with status True, code 0x00
2012-08-09 04:51:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM     8991   8 56148 17478409 A NORMAL'
2012-08-09 04:51:18 [INFO    ] Finished starting DRX
2012-08-09 04:51:18 [INFO    ] Finished starting DRX
2012-08-09 04:51:18 [INFO    ] Finished starting DRX
2012-08-09 04:51:18 [INFO    ] Finished starting DRX
2012-08-09 04:51:18 [INFO    ] Finished starting DRX
2012-08-09 04:51:18 [INFO    ] Finished starting DRX
2012-08-09 04:51:18 [INFO    ] Finished starting DRX
2012-08-09 04:51:18 [INFO    ] Finished starting DRX
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2012-08-09 04:51:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2012-08-09 04:51:18 [DEBUG   ] spawn_process: at 2012-08-09 04:51:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2012-08-09 04:51:24 [DEBUG   ] Finished updating ant stats in 1.180 seconds
2012-08-09 04:51:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 04:52:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 04:52:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 04:52:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 04:52:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 04:52:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 04:52:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-09 04:52:04 [DEBUG   ] Finished updating ant stats in 0.824 seconds
2012-08-09 04:52:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 04:52:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-09 04:52:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-09 04:52:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 04:52:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 04:52:04 [DEBUG   ] Finished updating board flags in 0.893 seconds
2012-08-09 04:52:24 [DEBUG   ] Finished updating ant stats in 0.780 seconds
2012-08-09 04:52:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 04:53:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 04:53:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-09 04:53:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 04:53:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 04:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 5
2012-08-09 04:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-09 04:53:04 [DEBUG   ] Finished updating ant stats in 0.624 seconds
2012-08-09 04:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-09 04:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 04:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 04:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-09 04:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-09 04:53:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-09 04:53:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 04:53:04 [DEBUG   ] Finished updating board flags in 0.885 seconds
2012-08-09 04:53:24 [DEBUG   ] Finished updating ant stats in 0.576 seconds
2012-08-09 04:53:44 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-09 04:54:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 04:54:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2012-08-09 04:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 04:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-09 04:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 04:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 04:54:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-09 04:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-09 04:54:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-09 04:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-09 04:54:04 [DEBUG   ] Finished updating ant stats in 0.429 seconds
2012-08-09 04:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 04:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 04:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 04:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-09 04:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-09 04:54:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-09 04:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 04:54:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 04:54:04 [DEBUG   ] Finished updating board flags in 1.099 seconds
2012-08-09 04:54:06 [DEBUG   ] Got command RPT from MCS: ref #8996
2012-08-09 04:54:06 [DEBUG   ] summary = NORMAL
2012-08-09 04:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8996  14 56148 17646364 A NORMALNORMAL'
2012-08-09 04:54:06 [DEBUG   ] Got command RPT from MCS: ref #8997
2012-08-09 04:54:06 [DEBUG   ] info = System calibrated and operating normally
2012-08-09 04:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8997  48 56148 17646365 A NORMALSystem calibrated and operating normally'
2012-08-09 04:54:24 [DEBUG   ] Finished updating ant stats in 0.376 seconds
2012-08-09 04:54:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 04:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 04:55:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 04:55:04 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-09 04:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 04:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2012-08-09 04:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 04:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-09 04:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-09 04:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 04:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-09 04:55:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-09 04:55:04 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa33, chip 2
2012-08-09 04:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 04:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 04:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 04:55:04 [DEBUG   ] Finished updating board flags in 1.049 seconds
2012-08-09 04:55:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 04:55:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 04:55:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 04:56:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-09 04:56:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 04:56:04 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa30, chip 2
2012-08-09 04:56:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-09 04:56:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2012-08-09 04:56:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 04:56:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-09 04:56:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-09 04:56:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 04:56:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-09 04:56:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 04:56:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2012-08-09 04:56:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-09 04:56:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-09 04:56:04 [DEBUG   ] Finished updating board flags in 0.992 seconds
2012-08-09 04:56:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 04:56:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 04:56:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 04:57:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-09 04:57:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 04:57:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 04:57:04 [WARNING ] MonitorFlags: Temperature 83.70 > 80 on hostname lwa30, chip 2
2012-08-09 04:57:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 04:57:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-09 04:57:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-09 04:57:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-09 04:57:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 04:57:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 04:57:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 04:57:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2012-08-09 04:57:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-09 04:57:04 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-09 04:57:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 3
2012-08-09 04:57:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-09 04:57:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2012-08-09 04:57:05 [DEBUG   ] Finished updating board flags in 0.904 seconds
2012-08-09 04:57:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 04:57:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 04:57:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 04:58:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 04:58:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 04:58:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-09 04:58:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 04:58:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 04:58:04 [WARNING ] MonitorFlags: Temperature 84.20 > 80 on hostname lwa30, chip 2
2012-08-09 04:58:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-09 04:58:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-09 04:58:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-09 04:58:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-09 04:58:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2012-08-09 04:58:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-09 04:58:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 4
2012-08-09 04:58:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 04:58:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 04:58:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-09 04:58:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-09 04:58:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-09 04:58:05 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa33, chip 2
2012-08-09 04:58:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 5
2012-08-09 04:58:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2012-08-09 04:58:05 [DEBUG   ] Finished updating board flags in 0.927 seconds
2012-08-09 04:58:05 [DEBUG   ] Finished updating ant stats in 0.813 seconds
2012-08-09 04:58:25 [DEBUG   ] Finished updating ant stats in 0.784 seconds
2012-08-09 04:58:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 04:59:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 04:59:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2012-08-09 04:59:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 04:59:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 04:59:04 [WARNING ] MonitorFlags: Temperature 84.70 > 80 on hostname lwa30, chip 2
2012-08-09 04:59:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-09 04:59:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-09 04:59:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-09 04:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 2
2012-08-09 04:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2012-08-09 04:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 04:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 04:59:05 [DEBUG   ] Finished updating ant stats in 0.620 seconds
2012-08-09 04:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-09 04:59:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-09 04:59:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-09 04:59:05 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa33, chip 2
2012-08-09 04:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 04:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 5
2012-08-09 04:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 04:59:05 [DEBUG   ] Finished updating board flags in 1.084 seconds
2012-08-09 04:59:06 [DEBUG   ] Got command RPT from MCS: ref #9013
2012-08-09 04:59:06 [DEBUG   ] summary = WARNING
2012-08-09 04:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9013  15 56148 17946365 AWARNINGWARNING'
2012-08-09 04:59:06 [DEBUG   ] Got command RPT from MCS: ref #9014
2012-08-09 04:59:06 [DEBUG   ] info = BOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD23_TEMP_MAX BOARD25_TEMP_MAX! 0x01! Multiple board temperature warnings - 4 boards
2012-08-09 04:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9014 128 56148 17946365 AWARNINGBOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD23_TEMP_MAX BOARD25_TEMP_MAX! 0x01! Multiple board temperature warnings - 4 boards'
2012-08-09 04:59:25 [DEBUG   ] Finished updating ant stats in 0.576 seconds
2012-08-09 04:59:45 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-09 05:00:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-09 05:00:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:00:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 05:00:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 3
2012-08-09 05:00:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:00:04 [WARNING ] MonitorFlags: Temperature 84.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:00:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 05:00:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2012-08-09 05:00:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-09 05:00:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:00:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:00:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-09 05:00:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-09 05:00:05 [DEBUG   ] Finished updating ant stats in 0.425 seconds
2012-08-09 05:00:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-09 05:00:05 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa33, chip 2
2012-08-09 05:00:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 05:00:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:00:05 [DEBUG   ] Finished updating board flags in 0.986 seconds
2012-08-09 05:00:25 [DEBUG   ] Finished updating ant stats in 0.372 seconds
2012-08-09 05:00:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:01:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-09 05:01:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-09 05:01:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 05:01:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:01:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2012-08-09 05:01:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-09 05:01:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:01:04 [WARNING ] MonitorFlags: Temperature 84.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:01:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-09 05:01:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:01:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 05:01:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:01:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-09 05:01:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:01:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-09 05:01:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-09 05:01:05 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:01:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:01:05 [DEBUG   ] Finished updating board flags in 0.912 seconds
2012-08-09 05:01:06 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 05:01:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 05:01:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 05:02:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2012-08-09 05:02:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-09 05:02:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-09 05:02:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:02:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 05:02:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-09 05:02:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 2
2012-08-09 05:02:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:02:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 05:02:05 [WARNING ] MonitorFlags: Temperature 84.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:02:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:02:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:02:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-09 05:02:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:02:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-09 05:02:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-09 05:02:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-09 05:02:05 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:02:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 2
2012-08-09 05:02:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-09 05:02:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:02:05 [DEBUG   ] Finished updating board flags in 0.924 seconds
2012-08-09 05:02:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 05:02:26 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2012-08-09 05:02:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 05:03:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-09 05:03:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 05:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:03:05 [WARNING ] MonitorFlags: Temperature 84.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-09 05:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-09 05:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-09 05:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 05:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-09 05:03:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-09 05:03:05 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 3
2012-08-09 05:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 5
2012-08-09 05:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-09 05:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:03:05 [DEBUG   ] Finished updating board flags in 1.085 seconds
2012-08-09 05:03:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 05:03:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 05:03:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 05:04:04 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-09 05:04:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:04:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:04:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-09 05:04:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2012-08-09 05:04:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-09 05:04:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 2
2012-08-09 05:04:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:04:05 [WARNING ] MonitorFlags: Temperature 84.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:04:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2012-08-09 05:04:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:04:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:04:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-09 05:04:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-09 05:04:05 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa33, chip 2
2012-08-09 05:04:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2012-08-09 05:04:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2012-08-09 05:04:05 [DEBUG   ] Finished updating board flags in 1.039 seconds
2012-08-09 05:04:06 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2012-08-09 05:04:06 [DEBUG   ] Got command RPT from MCS: ref #9030
2012-08-09 05:04:06 [DEBUG   ] summary = WARNING
2012-08-09 05:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9030  15 56148 18246360 AWARNINGWARNING'
2012-08-09 05:04:06 [DEBUG   ] Got command RPT from MCS: ref #9031
2012-08-09 05:04:06 [DEBUG   ] info = BOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD23_TEMP_MAX BOARD2_TEMP_MAX BOARD25_TEMP_MAX! 0x01! Multiple board temperature warnings - 5 boards
2012-08-09 05:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9031 144 56148 18246361 AWARNINGBOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD23_TEMP_MAX BOARD2_TEMP_MAX BOARD25_TEMP_MAX! 0x01! Multiple board temperature warnings - 5 boards'
2012-08-09 05:04:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 05:04:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 05:05:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-09 05:05:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:05:05 [WARNING ] MonitorFlags: Temperature 84.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:05:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-09 05:05:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-09 05:05:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-09 05:05:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-09 05:05:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 05:05:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:05:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-09 05:05:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:05:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-09 05:05:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-09 05:05:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-09 05:05:05 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:05:05 [DEBUG   ] Finished updating board flags in 1.014 seconds
2012-08-09 05:05:06 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2012-08-09 05:05:26 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-09 05:05:46 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-09 05:06:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-09 05:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-09 05:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-09 05:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 05:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-09 05:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 05:06:05 [WARNING ] MonitorFlags: Temperature 84.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 05:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 05:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-09 05:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-09 05:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 05:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:06:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-09 05:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-09 05:06:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-09 05:06:05 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:06:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 05:06:06 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-09 05:06:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:06:06 [DEBUG   ] Finished updating board flags in 1.299 seconds
2012-08-09 05:06:26 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-09 05:06:46 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-09 05:07:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-09 05:07:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-09 05:07:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2012-08-09 05:07:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-09 05:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:07:05 [WARNING ] MonitorFlags: Temperature 84.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-09 05:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 05:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-09 05:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 05:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-09 05:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-09 05:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:07:05 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2012-08-09 05:07:05 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 2
2012-08-09 05:07:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 05:07:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:07:06 [DEBUG   ] Finished updating board flags in 0.930 seconds
2012-08-09 05:07:06 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-09 05:07:26 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-09 05:07:46 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-09 05:08:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-09 05:08:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-09 05:08:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:08:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 05:08:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-09 05:08:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:08:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-09 05:08:05 [WARNING ] MonitorFlags: Temperature 84.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:08:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 05:08:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-09 05:08:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:08:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 05:08:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:08:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-09 05:08:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:08:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-09 05:08:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-09 05:08:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-09 05:08:06 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:08:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 05:08:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-09 05:08:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:08:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:08:06 [DEBUG   ] Finished updating board flags in 0.973 seconds
2012-08-09 05:08:06 [DEBUG   ] Finished updating ant stats in 0.420 seconds
2012-08-09 05:08:26 [DEBUG   ] Finished updating ant stats in 0.384 seconds
2012-08-09 05:08:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:09:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2012-08-09 05:09:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-09 05:09:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-09 05:09:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:09:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 05:09:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:09:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-09 05:09:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-09 05:09:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:09:05 [WARNING ] MonitorFlags: Temperature 84.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:09:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-09 05:09:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:09:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:09:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-09 05:09:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-09 05:09:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-09 05:09:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:09:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-09 05:09:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-09 05:09:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-09 05:09:06 [DEBUG   ] Got command RPT from MCS: ref #9047
2012-08-09 05:09:06 [DEBUG   ] summary = WARNING
2012-08-09 05:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9047  15 56148 18546369 AWARNINGWARNING'
2012-08-09 05:09:06 [DEBUG   ] Got command RPT from MCS: ref #9048
2012-08-09 05:09:06 [DEBUG   ] info = BOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD23_TEMP_MAX BOARD2_TEMP_MAX BOARD25_TEMP_MAX! 0x01! Multiple board temperature warnings - 5 boards
2012-08-09 05:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9048 144 56148 18546369 AWARNINGBOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD23_TEMP_MAX BOARD2_TEMP_MAX BOARD25_TEMP_MAX! 0x01! Multiple board temperature warnings - 5 boards'
2012-08-09 05:09:06 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:09:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2012-08-09 05:09:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:09:06 [DEBUG   ] Finished updating board flags in 1.070 seconds
2012-08-09 05:09:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 05:09:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:09:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 05:10:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-09 05:10:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 2
2012-08-09 05:10:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:10:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 05:10:05 [WARNING ] MonitorFlags: Temperature 84.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:10:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-09 05:10:05 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-09 05:10:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:10:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-09 05:10:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:10:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-09 05:10:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-09 05:10:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-09 05:10:06 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:10:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-09 05:10:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:10:06 [DEBUG   ] Finished updating board flags in 0.937 seconds
2012-08-09 05:10:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 05:10:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:10:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:11:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-09 05:11:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:11:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:11:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:11:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:11:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 05:11:05 [WARNING ] MonitorFlags: Temperature 84.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:11:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-09 05:11:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2012-08-09 05:11:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:11:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-09 05:11:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 4
2012-08-09 05:11:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:11:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-09 05:11:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-09 05:11:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-09 05:11:06 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:11:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2012-08-09 05:11:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:11:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:11:06 [DEBUG   ] Finished updating board flags in 0.905 seconds
2012-08-09 05:11:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 05:11:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 05:11:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:12:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-09 05:12:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-09 05:12:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:12:05 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2012-08-09 05:12:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:12:05 [WARNING ] MonitorFlags: Temperature 85.10 > 80 on hostname lwa30, chip 2
2012-08-09 05:12:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:12:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:12:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:12:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-09 05:12:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-09 05:12:06 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:12:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:12:06 [DEBUG   ] Finished updating board flags in 0.918 seconds
2012-08-09 05:12:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 05:12:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:12:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:13:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-09 05:13:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-09 05:13:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-09 05:13:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:13:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:13:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:13:07 [WARNING ] MonitorFlags: Temperature 85.10 > 80 on hostname lwa30, chip 2
2012-08-09 05:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 05:13:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 05:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-09 05:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 05:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:13:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:13:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-09 05:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-09 05:13:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-09 05:13:07 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa33, chip 2
2012-08-09 05:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 05:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-09 05:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2012-08-09 05:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:13:07 [DEBUG   ] Finished updating board flags in 2.156 seconds
2012-08-09 05:13:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:13:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2012-08-09 05:14:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-09 05:14:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-09 05:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 2
2012-08-09 05:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 05:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-09 05:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 05:14:06 [WARNING ] MonitorFlags: Temperature 85.10 > 80 on hostname lwa30, chip 2
2012-08-09 05:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-09 05:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-09 05:14:06 [DEBUG   ] Got command RPT from MCS: ref #9064
2012-08-09 05:14:06 [DEBUG   ] summary = WARNING
2012-08-09 05:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9064  15 56148 18846365 AWARNINGWARNING'
2012-08-09 05:14:06 [DEBUG   ] Got command RPT from MCS: ref #9065
2012-08-09 05:14:06 [DEBUG   ] info = BOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD23_TEMP_MAX BOARD25_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 5 boards
2012-08-09 05:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9065 144 56148 18846365 AWARNINGBOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD23_TEMP_MAX BOARD25_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 5 boards'
2012-08-09 05:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-09 05:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-09 05:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-09 05:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:14:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-09 05:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-09 05:14:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-09 05:14:06 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:14:06 [DEBUG   ] Finished updating board flags in 1.016 seconds
2012-08-09 05:14:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 05:14:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:14:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:15:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-09 05:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:15:06 [WARNING ] MonitorFlags: Temperature 85.10 > 80 on hostname lwa30, chip 2
2012-08-09 05:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-09 05:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 05:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-09 05:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-09 05:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 05:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-09 05:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-09 05:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:15:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2012-08-09 05:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 1
2012-08-09 05:15:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-09 05:15:06 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 05:15:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:15:06 [DEBUG   ] Finished updating board flags in 1.013 seconds
2012-08-09 05:15:07 [DEBUG   ] Finished updating ant stats in 1.085 seconds
2012-08-09 05:15:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 05:15:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 05:16:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-09 05:16:06 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-09 05:16:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:16:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:16:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:16:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-09 05:16:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:16:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 05:16:07 [WARNING ] MonitorFlags: Temperature 85.10 > 80 on hostname lwa30, chip 2
2012-08-09 05:16:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 05:16:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-09 05:16:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:16:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:16:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:16:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-09 05:16:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2012-08-09 05:16:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 1
2012-08-09 05:16:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-09 05:16:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-09 05:16:07 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:16:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2012-08-09 05:16:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:16:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2012-08-09 05:16:07 [DEBUG   ] Finished updating board flags in 1.994 seconds
2012-08-09 05:16:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 05:16:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 05:17:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-09 05:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-09 05:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2012-08-09 05:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-09 05:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 05:17:06 [WARNING ] MonitorFlags: Temperature 85.10 > 80 on hostname lwa30, chip 2
2012-08-09 05:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 05:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-09 05:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-09 05:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2012-08-09 05:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-09 05:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-09 05:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-09 05:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:17:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2012-08-09 05:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-09 05:17:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-09 05:17:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-09 05:17:07 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:17:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2012-08-09 05:17:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:17:07 [DEBUG   ] Finished updating board flags in 0.912 seconds
2012-08-09 05:17:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 05:17:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 05:17:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 05:18:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2012-08-09 05:18:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-09 05:18:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-09 05:18:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-09 05:18:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2012-08-09 05:18:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 05:18:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:18:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-09 05:18:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:18:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 05:18:06 [WARNING ] MonitorFlags: Temperature 85.10 > 80 on hostname lwa30, chip 2
2012-08-09 05:18:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 05:18:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-09 05:18:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-09 05:18:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-09 05:18:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-09 05:18:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:18:07 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-09 05:18:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-09 05:18:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:18:07 [DEBUG   ] Finished updating ant stats in 1.025 seconds
2012-08-09 05:18:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-09 05:18:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2012-08-09 05:18:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-09 05:18:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:18:07 [DEBUG   ] Finished updating board flags in 1.161 seconds
2012-08-09 05:18:27 [DEBUG   ] Finished updating ant stats in 0.977 seconds
2012-08-09 05:18:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 05:19:06 [DEBUG   ] Got command RPT from MCS: ref #9081
2012-08-09 05:19:06 [DEBUG   ] summary = WARNING
2012-08-09 05:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9081  15 56148 19146364 AWARNINGWARNING'
2012-08-09 05:19:06 [DEBUG   ] Got command RPT from MCS: ref #9082
2012-08-09 05:19:06 [DEBUG   ] info = BOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD23_TEMP_MAX BOARD25_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 5 boards
2012-08-09 05:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9082 144 56148 19146365 AWARNINGBOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD23_TEMP_MAX BOARD25_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 5 boards'
2012-08-09 05:19:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-09 05:19:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:19:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-09 05:19:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:19:06 [WARNING ] MonitorFlags: Temperature 85.10 > 80 on hostname lwa30, chip 2
2012-08-09 05:19:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-09 05:19:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-09 05:19:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 05:19:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2012-08-09 05:19:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 5
2012-08-09 05:19:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 05:19:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:19:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:19:07 [DEBUG   ] Finished updating ant stats in 0.826 seconds
2012-08-09 05:19:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-09 05:19:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-09 05:19:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-09 05:19:07 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:19:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 05:19:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:19:07 [DEBUG   ] Finished updating board flags in 1.009 seconds
2012-08-09 05:19:27 [DEBUG   ] Finished updating ant stats in 0.777 seconds
2012-08-09 05:19:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 05:20:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-09 05:20:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 05:20:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:20:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:20:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:20:06 [WARNING ] MonitorFlags: Temperature 85.10 > 80 on hostname lwa30, chip 2
2012-08-09 05:20:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-09 05:20:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-09 05:20:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2012-08-09 05:20:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-09 05:20:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 05:20:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:20:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-09 05:20:07 [DEBUG   ] Finished updating ant stats in 0.625 seconds
2012-08-09 05:20:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-09 05:20:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:20:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-09 05:20:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-09 05:20:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-09 05:20:07 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:20:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2012-08-09 05:20:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:20:07 [DEBUG   ] Finished updating board flags in 1.039 seconds
2012-08-09 05:20:27 [DEBUG   ] Finished updating ant stats in 0.577 seconds
2012-08-09 05:20:47 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-09 05:21:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-09 05:21:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2012-08-09 05:21:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2012-08-09 05:21:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:21:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-09 05:21:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-09 05:21:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 2
2012-08-09 05:21:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 05:21:06 [WARNING ] MonitorFlags: Temperature 85.10 > 80 on hostname lwa30, chip 2
2012-08-09 05:21:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 05:21:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-09 05:21:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-09 05:21:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-09 05:21:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-09 05:21:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2012-08-09 05:21:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:21:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:21:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-09 05:21:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:21:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2012-08-09 05:21:07 [DEBUG   ] Finished updating ant stats in 0.424 seconds
2012-08-09 05:21:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-09 05:21:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-09 05:21:07 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa33, chip 2
2012-08-09 05:21:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:21:07 [DEBUG   ] Finished updating board flags in 0.927 seconds
2012-08-09 05:21:27 [DEBUG   ] Finished updating ant stats in 0.381 seconds
2012-08-09 05:21:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:22:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-09 05:22:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:22:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:22:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2012-08-09 05:22:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:22:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 2
2012-08-09 05:22:06 [WARNING ] MonitorFlags: Temperature 85.10 > 80 on hostname lwa30, chip 2
2012-08-09 05:22:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 05:22:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-09 05:22:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-09 05:22:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:22:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:22:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:22:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-09 05:22:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-09 05:22:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-09 05:22:07 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:22:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 05:22:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2012-08-09 05:22:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2012-08-09 05:22:07 [DEBUG   ] Finished updating board flags in 0.901 seconds
2012-08-09 05:22:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:22:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:22:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:23:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-09 05:23:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-09 05:23:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 2
2012-08-09 05:23:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:23:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 05:23:07 [WARNING ] MonitorFlags: Temperature 84.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:23:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-09 05:23:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 05:23:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:23:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:23:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-09 05:23:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-09 05:23:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-09 05:23:07 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:23:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2012-08-09 05:23:07 [DEBUG   ] Finished updating board flags in 0.942 seconds
2012-08-09 05:23:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:23:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:23:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:24:06 [DEBUG   ] Got command RPT from MCS: ref #9098
2012-08-09 05:24:06 [DEBUG   ] summary = WARNING
2012-08-09 05:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9098  15 56148 19446365 AWARNINGWARNING'
2012-08-09 05:24:06 [DEBUG   ] Got command RPT from MCS: ref #9099
2012-08-09 05:24:06 [DEBUG   ] info = BOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD23_TEMP_MAX BOARD25_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 5 boards
2012-08-09 05:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9099 144 56148 19446365 AWARNINGBOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD23_TEMP_MAX BOARD25_TEMP_MAX BOARD2_TEMP_MAX! 0x01! Multiple board temperature warnings - 5 boards'
2012-08-09 05:24:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-09 05:24:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-09 05:24:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:24:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:24:07 [WARNING ] MonitorFlags: Temperature 84.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:24:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-09 05:24:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:24:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-09 05:24:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-09 05:24:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-09 05:24:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2012-08-09 05:24:07 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa33, chip 2
2012-08-09 05:24:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 05:24:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-09 05:24:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2012-08-09 05:24:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:24:07 [DEBUG   ] Finished updating board flags in 1.120 seconds
2012-08-09 05:24:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:24:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:24:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:25:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2012-08-09 05:25:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-09 05:25:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-09 05:25:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:25:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:25:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:25:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-09 05:25:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:25:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 05:25:07 [WARNING ] MonitorFlags: Temperature 84.20 > 80 on hostname lwa30, chip 2
2012-08-09 05:25:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 05:25:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-09 05:25:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-09 05:25:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-09 05:25:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:25:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-09 05:25:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:25:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-09 05:25:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-09 05:25:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:25:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2012-08-09 05:25:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:25:07 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa33, chip 2
2012-08-09 05:25:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-09 05:25:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:25:07 [DEBUG   ] Finished updating board flags in 0.957 seconds
2012-08-09 05:25:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:25:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:25:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:26:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 05:26:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:26:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:26:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-09 05:26:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:26:07 [WARNING ] MonitorFlags: Temperature 83.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:26:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 05:26:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-09 05:26:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-09 05:26:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 05:26:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-09 05:26:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:26:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2012-08-09 05:26:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-09 05:26:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:26:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:26:08 [DEBUG   ] Finished updating board flags in 0.920 seconds
2012-08-09 05:26:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:26:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:26:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:27:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:27:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:27:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2012-08-09 05:27:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:27:07 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa30, chip 2
2012-08-09 05:27:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-09 05:27:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-09 05:27:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-09 05:27:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:27:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-09 05:27:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2012-08-09 05:27:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-09 05:27:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-09 05:27:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-09 05:27:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:27:08 [DEBUG   ] Finished updating ant stats in 1.224 seconds
2012-08-09 05:27:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:27:08 [DEBUG   ] Finished updating board flags in 1.028 seconds
2012-08-09 05:27:28 [DEBUG   ] Finished updating ant stats in 1.177 seconds
2012-08-09 05:27:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 05:28:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 05:28:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:28:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:28:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:28:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 05:28:07 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa30, chip 2
2012-08-09 05:28:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-09 05:28:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:28:08 [DEBUG   ] Finished updating ant stats in 1.031 seconds
2012-08-09 05:28:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2012-08-09 05:28:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:28:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:28:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:28:08 [DEBUG   ] Finished updating board flags in 1.227 seconds
2012-08-09 05:28:28 [DEBUG   ] Finished updating ant stats in 0.973 seconds
2012-08-09 05:28:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 05:29:06 [DEBUG   ] Got command RPT from MCS: ref #9115
2012-08-09 05:29:06 [DEBUG   ] summary = WARNING
2012-08-09 05:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9115  15 56148 19746368 AWARNINGWARNING'
2012-08-09 05:29:06 [DEBUG   ] Got command RPT from MCS: ref #9116
2012-08-09 05:29:06 [DEBUG   ] info = BOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD23_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards
2012-08-09 05:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9116 111 56148 19746369 AWARNINGBOARD26_TEMP_MAX BOARD9_TEMP_MAX BOARD23_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards'
2012-08-09 05:29:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:29:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:29:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 4
2012-08-09 05:29:07 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:29:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 05:29:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-09 05:29:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-09 05:29:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:29:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 5
2012-08-09 05:29:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 05:29:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:29:08 [DEBUG   ] Finished updating ant stats in 0.830 seconds
2012-08-09 05:29:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:29:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-09 05:29:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-09 05:29:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-09 05:29:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-09 05:29:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 5
2012-08-09 05:29:08 [DEBUG   ] Finished updating board flags in 1.233 seconds
2012-08-09 05:29:28 [DEBUG   ] Finished updating ant stats in 0.773 seconds
2012-08-09 05:29:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 05:30:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2012-08-09 05:30:07 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-09 05:30:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-09 05:30:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:30:07 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 05:30:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:30:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:30:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-09 05:30:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 05:30:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 05:30:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-09 05:30:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-09 05:30:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:30:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 05:30:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:30:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-09 05:30:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:30:08 [DEBUG   ] Finished updating ant stats in 0.624 seconds
2012-08-09 05:30:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-09 05:30:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:30:08 [DEBUG   ] Finished updating board flags in 1.066 seconds
2012-08-09 05:30:28 [DEBUG   ] Finished updating ant stats in 0.577 seconds
2012-08-09 05:30:48 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-09 05:31:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:31:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:31:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:31:07 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-09 05:31:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-09 05:31:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-09 05:31:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:31:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2012-08-09 05:31:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 05:31:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 4
2012-08-09 05:31:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:31:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:31:08 [DEBUG   ] Finished updating ant stats in 0.425 seconds
2012-08-09 05:31:08 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-09 05:31:08 [DEBUG   ] Finished updating board flags in 1.035 seconds
2012-08-09 05:31:28 [DEBUG   ] Finished updating ant stats in 0.377 seconds
2012-08-09 05:31:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 05:32:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:32:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 05:32:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-09 05:32:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2012-08-09 05:32:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-09 05:32:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:32:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:32:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 05:32:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 05:32:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2012-08-09 05:32:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2012-08-09 05:32:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:32:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-09 05:32:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:32:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-09 05:32:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-09 05:32:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-09 05:32:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:32:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 05:32:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:32:08 [DEBUG   ] Finished updating board flags in 0.920 seconds
2012-08-09 05:32:09 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2012-08-09 05:32:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 05:32:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 05:33:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:33:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:33:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:33:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-09 05:33:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 05:33:07 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 05:33:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:33:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2012-08-09 05:33:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 5
2012-08-09 05:33:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:33:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 05:33:09 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-09 05:33:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 05:33:09 [DEBUG   ] Finished updating board flags in 1.809 seconds
2012-08-09 05:33:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 05:33:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 05:34:06 [DEBUG   ] Got command RPT from MCS: ref #9132
2012-08-09 05:34:06 [DEBUG   ] summary = NORMAL
2012-08-09 05:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9132  14 56148 20046369 A NORMALNORMAL'
2012-08-09 05:34:06 [DEBUG   ] Got command RPT from MCS: ref #9133
2012-08-09 05:34:06 [DEBUG   ] info = Warning condition cleared, system operating normally
2012-08-09 05:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9133  60 56148 20046369 A NORMALWarning condition cleared, system operating normally'
2012-08-09 05:34:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:34:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-09 05:34:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 05:34:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 05:34:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-09 05:34:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-09 05:34:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-09 05:34:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 05:34:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:34:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 5
2012-08-09 05:34:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:34:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-09 05:34:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:34:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 05:34:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:34:08 [DEBUG   ] Finished updating board flags in 0.881 seconds
2012-08-09 05:34:09 [DEBUG   ] Finished updating ant stats in 0.993 seconds
2012-08-09 05:34:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 05:34:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 05:35:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:35:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:35:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:35:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:35:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 05:35:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:35:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 05:35:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:35:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:35:08 [DEBUG   ] Finished updating board flags in 0.878 seconds
2012-08-09 05:35:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 05:35:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 05:35:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 05:36:07 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 05:36:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:36:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:36:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:36:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-09 05:36:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 05:36:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 05:36:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:36:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2012-08-09 05:36:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:36:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-09 05:36:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-09 05:36:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:36:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:36:08 [DEBUG   ] Finished updating board flags in 0.958 seconds
2012-08-09 05:36:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 05:36:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 05:36:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 05:37:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:37:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 05:37:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-09 05:37:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-09 05:37:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 05:37:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:37:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:37:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:37:08 [DEBUG   ] Finished updating board flags in 1.082 seconds
2012-08-09 05:37:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 05:37:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 05:37:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 05:38:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2012-08-09 05:38:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2012-08-09 05:38:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 05:38:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-09 05:38:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:38:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:38:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-09 05:38:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-09 05:38:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2012-08-09 05:38:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:38:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:38:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-09 05:38:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-09 05:38:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-09 05:38:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:38:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 05:38:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:38:09 [DEBUG   ] Finished updating board flags in 1.054 seconds
2012-08-09 05:38:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 05:38:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 05:38:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 05:39:06 [DEBUG   ] Got command RPT from MCS: ref #9149
2012-08-09 05:39:06 [DEBUG   ] summary = NORMAL
2012-08-09 05:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9149  14 56148 20346365 A NORMALNORMAL'
2012-08-09 05:39:06 [DEBUG   ] Got command RPT from MCS: ref #9150
2012-08-09 05:39:06 [DEBUG   ] info = Warning condition cleared, system operating normally
2012-08-09 05:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9150  60 56148 20346365 A NORMALWarning condition cleared, system operating normally'
2012-08-09 05:39:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 05:39:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:39:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-09 05:39:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:39:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:39:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 05:39:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 1
2012-08-09 05:39:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:39:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 05:39:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-09 05:39:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:39:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:39:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-09 05:39:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:39:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-09 05:39:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:39:09 [DEBUG   ] Finished updating board flags in 1.738 seconds
2012-08-09 05:39:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 05:39:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 05:40:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2012-08-09 05:40:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:40:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:40:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:40:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-09 05:40:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 4
2012-08-09 05:40:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:40:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 05:40:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 05:40:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:40:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-09 05:40:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:40:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-09 05:40:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:40:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:40:09 [DEBUG   ] Finished updating board flags in 0.927 seconds
2012-08-09 05:40:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 05:40:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 05:40:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 05:41:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:41:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 05:41:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:41:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-09 05:41:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 05:41:08 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 05:41:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-09 05:41:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-09 05:41:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2012-08-09 05:41:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-09 05:41:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 05:41:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:41:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:41:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-09 05:41:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-09 05:41:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-09 05:41:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:41:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:41:09 [DEBUG   ] Finished updating board flags in 0.961 seconds
2012-08-09 05:41:09 [DEBUG   ] Finished updating ant stats in 0.824 seconds
2012-08-09 05:41:29 [DEBUG   ] Finished updating ant stats in 0.782 seconds
2012-08-09 05:41:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 05:42:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2012-08-09 05:42:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:42:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 4
2012-08-09 05:42:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-09 05:42:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 05:42:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 4
2012-08-09 05:42:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:42:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-09 05:42:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-09 05:42:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:42:09 [DEBUG   ] Finished updating ant stats in 0.625 seconds
2012-08-09 05:42:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-09 05:42:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-09 05:42:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-09 05:42:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:42:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 05:42:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-09 05:42:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 4
2012-08-09 05:42:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:42:09 [DEBUG   ] Finished updating board flags in 1.020 seconds
2012-08-09 05:42:29 [DEBUG   ] Finished updating ant stats in 0.578 seconds
2012-08-09 05:42:49 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-09 05:43:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-09 05:43:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:43:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:43:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-09 05:43:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-09 05:43:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 05:43:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-09 05:43:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:43:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-09 05:43:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2012-08-09 05:43:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 05:43:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:43:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:43:09 [DEBUG   ] Finished updating ant stats in 0.427 seconds
2012-08-09 05:43:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-09 05:43:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 2
2012-08-09 05:43:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 05:43:09 [DEBUG   ] Finished updating board flags in 1.003 seconds
2012-08-09 05:43:29 [DEBUG   ] Finished updating ant stats in 0.378 seconds
2012-08-09 05:43:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 05:44:06 [DEBUG   ] Got command RPT from MCS: ref #9166
2012-08-09 05:44:06 [DEBUG   ] summary = NORMAL
2012-08-09 05:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9166  14 56148 20646368 A NORMALNORMAL'
2012-08-09 05:44:06 [DEBUG   ] Got command RPT from MCS: ref #9167
2012-08-09 05:44:06 [DEBUG   ] info = Warning condition cleared, system operating normally
2012-08-09 05:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9167  60 56148 20646369 A NORMALWarning condition cleared, system operating normally'
2012-08-09 05:44:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:44:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:44:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:44:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-09 05:44:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-09 05:44:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-09 05:44:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-09 05:44:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:44:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:44:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:44:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-09 05:44:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:44:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 05:44:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:44:09 [DEBUG   ] Finished updating board flags in 0.956 seconds
2012-08-09 05:44:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 05:44:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 05:44:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 05:45:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:45:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:45:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-09 05:45:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:45:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 05:45:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-09 05:45:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-09 05:45:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 05:45:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-09 05:45:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:45:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2012-08-09 05:45:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:45:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-09 05:45:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:45:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-09 05:45:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-09 05:45:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:45:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 05:45:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:45:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2012-08-09 05:45:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 4
2012-08-09 05:45:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:45:09 [DEBUG   ] Finished updating board flags in 1.337 seconds
2012-08-09 05:45:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 05:45:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 05:45:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 05:46:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-09 05:46:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 05:46:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:46:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:46:09 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa30, chip 2
2012-08-09 05:46:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-09 05:46:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-09 05:46:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:46:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-09 05:46:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:46:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-09 05:46:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-09 05:46:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:46:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:46:09 [DEBUG   ] Finished updating board flags in 0.907 seconds
2012-08-09 05:46:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 05:46:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2012-08-09 05:46:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 05:47:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 05:47:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2012-08-09 05:47:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:47:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:47:09 [WARNING ] MonitorFlags: Temperature 83.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:47:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 05:47:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 05:47:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-09 05:47:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-09 05:47:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:47:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-09 05:47:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:47:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-09 05:47:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-09 05:47:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 1
2012-08-09 05:47:09 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-09 05:47:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 05:47:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:47:09 [DEBUG   ] Finished updating board flags in 1.090 seconds
2012-08-09 05:47:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 05:47:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 05:47:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 05:48:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-09 05:48:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-09 05:48:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:48:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 05:48:09 [WARNING ] MonitorFlags: Temperature 84.20 > 80 on hostname lwa30, chip 2
2012-08-09 05:48:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 05:48:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-09 05:48:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-09 05:48:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-09 05:48:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-09 05:48:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-09 05:48:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:48:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:48:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2012-08-09 05:48:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-09 05:48:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-09 05:48:09 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:48:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 3
2012-08-09 05:48:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:48:10 [DEBUG   ] Finished updating board flags in 1.073 seconds
2012-08-09 05:48:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 05:48:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 05:48:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 05:49:06 [DEBUG   ] Got command RPT from MCS: ref #9183
2012-08-09 05:49:06 [DEBUG   ] summary = WARNING
2012-08-09 05:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9183  15 56148 20946372 AWARNINGWARNING'
2012-08-09 05:49:06 [DEBUG   ] Got command RPT from MCS: ref #9184
2012-08-09 05:49:06 [DEBUG   ] info = BOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD23_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards
2012-08-09 05:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9184 111 56148 20946373 AWARNINGBOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD23_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards'
2012-08-09 05:49:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2012-08-09 05:49:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-09 05:49:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:49:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2012-08-09 05:49:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:49:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-09 05:49:09 [WARNING ] MonitorFlags: Temperature 85.10 > 80 on hostname lwa30, chip 2
2012-08-09 05:49:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-09 05:49:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-09 05:49:09 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-09 05:49:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2012-08-09 05:49:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:49:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-09 05:49:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:49:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:49:09 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2012-08-09 05:49:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-09 05:49:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-09 05:49:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 05:49:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-09 05:49:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:49:10 [DEBUG   ] Finished updating board flags in 1.007 seconds
2012-08-09 05:49:10 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-09 05:49:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 05:49:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 05:50:09 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-09 05:50:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:50:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2012-08-09 05:50:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:50:09 [WARNING ] MonitorFlags: Temperature 85.10 > 80 on hostname lwa30, chip 2
2012-08-09 05:50:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 05:50:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa12, chip 4
2012-08-09 05:50:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 05:50:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-09 05:50:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-09 05:50:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-09 05:50:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:50:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:50:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-09 05:50:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-09 05:50:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:50:09 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2012-08-09 05:50:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-09 05:50:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 05:50:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2012-08-09 05:50:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:50:09 [DEBUG   ] Finished updating board flags in 0.920 seconds
2012-08-09 05:50:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 05:50:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 05:50:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 05:51:09 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa27, chip 2
2012-08-09 05:51:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 05:51:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:51:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2012-08-09 05:51:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-09 05:51:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:51:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 05:51:09 [WARNING ] MonitorFlags: Temperature 84.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:51:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-09 05:51:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:51:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:51:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2012-08-09 05:51:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:51:10 [DEBUG   ] Finished updating ant stats in 0.826 seconds
2012-08-09 05:51:10 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2012-08-09 05:51:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-09 05:51:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-09 05:51:10 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:51:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 05:51:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-09 05:51:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 1
2012-08-09 05:51:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:51:10 [DEBUG   ] Finished updating board flags in 1.301 seconds
2012-08-09 05:51:30 [DEBUG   ] Finished updating ant stats in 0.778 seconds
2012-08-09 05:51:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 05:52:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa27, chip 2
2012-08-09 05:52:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2012-08-09 05:52:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 05:52:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 2
2012-08-09 05:52:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:52:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:52:09 [WARNING ] MonitorFlags: Temperature 84.20 > 80 on hostname lwa30, chip 2
2012-08-09 05:52:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 5
2012-08-09 05:52:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-09 05:52:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-09 05:52:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-09 05:52:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:52:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:52:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-09 05:52:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:52:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2012-08-09 05:52:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-09 05:52:10 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:52:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:52:10 [DEBUG   ] Finished updating board flags in 0.868 seconds
2012-08-09 05:52:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 05:52:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 05:52:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 05:53:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:53:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:53:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:53:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:53:09 [WARNING ] MonitorFlags: Temperature 83.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:53:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-09 05:53:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 5
2012-08-09 05:53:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 05:53:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 3
2012-08-09 05:53:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-09 05:53:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:53:10 [DEBUG   ] Finished updating ant stats in 0.627 seconds
2012-08-09 05:53:10 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2012-08-09 05:53:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-09 05:53:10 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-09 05:53:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:53:10 [DEBUG   ] Finished updating board flags in 1.157 seconds
2012-08-09 05:53:30 [DEBUG   ] Finished updating ant stats in 0.578 seconds
2012-08-09 05:53:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-09 05:54:06 [DEBUG   ] Got command RPT from MCS: ref #9200
2012-08-09 05:54:06 [DEBUG   ] summary = WARNING
2012-08-09 05:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9200  15 56148 21246373 AWARNINGWARNING'
2012-08-09 05:54:06 [DEBUG   ] Got command RPT from MCS: ref #9201
2012-08-09 05:54:06 [DEBUG   ] info = BOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD23_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards
2012-08-09 05:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9201 111 56148 21246373 AWARNINGBOARD9_TEMP_MAX BOARD26_TEMP_MAX BOARD23_TEMP_MAX! 0x01! Multiple board temperature warnings - 3 boards'
2012-08-09 05:54:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-09 05:54:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 05:54:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:54:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:54:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-09 05:54:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:54:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 05:54:09 [WARNING ] MonitorFlags: Temperature 83.20 > 80 on hostname lwa30, chip 2
2012-08-09 05:54:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-09 05:54:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-09 05:54:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:54:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-09 05:54:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 05:54:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:54:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2012-08-09 05:54:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:54:10 [DEBUG   ] Finished updating ant stats in 0.426 seconds
2012-08-09 05:54:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2012-08-09 05:54:10 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa33, chip 2
2012-08-09 05:54:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 2
2012-08-09 05:54:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:54:10 [DEBUG   ] Finished updating board flags in 0.968 seconds
2012-08-09 05:54:30 [DEBUG   ] Finished updating ant stats in 0.378 seconds
2012-08-09 05:54:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 05:55:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:55:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-09 05:55:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-09 05:55:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:55:09 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:55:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 05:55:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-09 05:55:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:55:11 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 05:55:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-09 05:55:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:55:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2012-08-09 05:55:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:55:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-09 05:55:11 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:55:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:55:11 [DEBUG   ] Finished updating board flags in 2.008 seconds
2012-08-09 05:55:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 05:55:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 05:56:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-09 05:56:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:56:09 [WARNING ] MonitorFlags: Temperature 82.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:56:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 05:56:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-09 05:56:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-09 05:56:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-09 05:56:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:56:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:56:10 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-09 05:56:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 2
2012-08-09 05:56:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 3
2012-08-09 05:56:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 05:56:10 [DEBUG   ] Finished updating board flags in 0.898 seconds
2012-08-09 05:56:11 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2012-08-09 05:56:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 05:56:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 05:57:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 05:57:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 05:57:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:57:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:57:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 05:57:09 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-09 05:57:10 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 05:57:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:57:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 5
2012-08-09 05:57:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:57:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-09 05:57:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 1
2012-08-09 05:57:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-09 05:57:10 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:57:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 05:57:10 [DEBUG   ] Finished updating board flags in 0.912 seconds
2012-08-09 05:57:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 05:57:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 05:57:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 05:58:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 05:58:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:58:10 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-09 05:58:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-09 05:58:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-09 05:58:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-09 05:58:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:58:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-09 05:58:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 05:58:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:58:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-09 05:58:10 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-09 05:58:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 4
2012-08-09 05:58:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 05:58:10 [DEBUG   ] Finished updating board flags in 1.103 seconds
2012-08-09 05:58:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 05:58:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 05:58:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 05:59:06 [DEBUG   ] Got command RPT from MCS: ref #9217
2012-08-09 05:59:06 [DEBUG   ] summary = NORMAL
2012-08-09 05:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9217  14 56148 21546377 A NORMALNORMAL'
2012-08-09 05:59:06 [DEBUG   ] Got command RPT from MCS: ref #9218
2012-08-09 05:59:06 [DEBUG   ] info = Warning condition cleared, system operating normally
2012-08-09 05:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9218  60 56148 21546377 A NORMALWarning condition cleared, system operating normally'
2012-08-09 05:59:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 05:59:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 05:59:10 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-09 05:59:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 1
2012-08-09 05:59:11 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-09 05:59:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 05:59:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-09 05:59:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 05:59:11 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-09 05:59:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 05:59:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 05:59:11 [DEBUG   ] Finished updating board flags in 1.989 seconds
2012-08-09 05:59:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 05:59:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 06:00:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 06:00:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 06:00:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-09 06:00:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 06:00:10 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa30, chip 2
2012-08-09 06:00:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2012-08-09 06:00:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-09 06:00:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-09 06:00:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-09 06:00:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 06:00:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-09 06:00:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 06:00:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-09 06:00:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2012-08-09 06:00:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-09 06:00:10 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-09 06:00:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-09 06:00:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 06:00:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 06:00:11 [DEBUG   ] Finished updating board flags in 0.889 seconds
2012-08-09 06:00:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 06:00:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 06:00:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 06:01:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2012-08-09 06:01:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 06:01:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 06:01:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 06:01:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 06:01:10 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-09 06:01:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 06:01:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 06:01:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2012-08-09 06:01:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-09 06:01:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-09 06:01:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 06:01:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 5
2012-08-09 06:01:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2012-08-09 06:01:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 06:01:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2012-08-09 06:01:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2012-08-09 06:01:11 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa33, chip 2
2012-08-09 06:01:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 1
2012-08-09 06:01:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 06:01:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 4
2012-08-09 06:01:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 06:01:11 [DEBUG   ] Finished updating board flags in 0.914 seconds
2012-08-09 06:01:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 06:01:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 06:01:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 06:02:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 1
2012-08-09 06:02:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 06:02:10 [WARNING ] MonitorFlags: VCCINT 0.976 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 06:02:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 06:02:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 06:02:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2012-08-09 06:02:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 06:02:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 06:02:10 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa30, chip 2
2012-08-09 06:02:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 06:02:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2012-08-09 06:02:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 06:02:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 06:02:11 [DEBUG   ] Finished updating ant stats in 0.624 seconds
2012-08-09 06:02:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 06:02:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2012-08-09 06:02:11 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-09 06:02:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 06:02:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 06:02:11 [DEBUG   ] Finished updating board flags in 1.147 seconds
2012-08-09 06:02:31 [DEBUG   ] Finished updating ant stats in 0.575 seconds
2012-08-09 06:02:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-09 06:03:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2012-08-09 06:03:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 06:03:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 06:03:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2012-08-09 06:03:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2012-08-09 06:03:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 06:03:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 06:03:10 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-09 06:03:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2012-08-09 06:03:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2012-08-09 06:03:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-09 06:03:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-09 06:03:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 5
2012-08-09 06:03:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2012-08-09 06:03:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2012-08-09 06:03:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 06:03:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 06:03:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 06:03:11 [DEBUG   ] Finished updating ant stats in 0.425 seconds
2012-08-09 06:03:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2012-08-09 06:03:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 06:03:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 06:03:11 [DEBUG   ] Finished updating board flags in 0.953 seconds
2012-08-09 06:03:31 [DEBUG   ] Finished updating ant stats in 0.379 seconds
2012-08-09 06:03:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 06:04:06 [DEBUG   ] Got command RPT from MCS: ref #9234
2012-08-09 06:04:06 [DEBUG   ] summary = NORMAL
2012-08-09 06:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9234  14 56148 21846404 A NORMALNORMAL'
2012-08-09 06:04:06 [DEBUG   ] Got command RPT from MCS: ref #9235
2012-08-09 06:04:06 [DEBUG   ] info = Warning condition cleared, system operating normally
2012-08-09 06:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9235  60 56148 21846440 A NORMALWarning condition cleared, system operating normally'
2012-08-09 06:04:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2012-08-09 06:04:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 06:04:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2012-08-09 06:04:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2012-08-09 06:04:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 1
2012-08-09 06:04:10 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa30, chip 2
2012-08-09 06:04:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2012-08-09 06:04:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2012-08-09 06:04:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2012-08-09 06:04:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2012-08-09 06:04:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2012-08-09 06:04:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2012-08-09 06:04:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2012-08-09 06:04:11 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa33, chip 2
2012-08-09 06:04:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2012-08-09 06:04:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2012-08-09 06:04:11 [DEBUG   ] Finished updating board flags in 0.903 seconds
2012-08-09 06:04:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 06:04:12 [DEBUG   ] Got command INI from MCS: ref #9251
2012-08-09 06:04:12 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2012-08-09 06:04:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI     9251   8 56148 21852284 ABOOTING'
2012-08-09 06:04:29 [INFO    ] -------------------
2012-08-09 06:04:29 [INFO    ]  LWA board status
2012-08-09 06:04:29 [INFO    ] -------------------
2012-08-09 06:04:29 [INFO    ] DP 1: 2 lwa27
2012-08-09 06:04:29 [INFO    ] DP 1: 3 lwa24
2012-08-09 06:04:29 [INFO    ] DP 1: 4 lwa23
2012-08-09 06:04:29 [INFO    ] DP 1: 5 lwa18
2012-08-09 06:04:29 [INFO    ] DP 1: 6 lwa10
2012-08-09 06:04:29 [INFO    ] DP 1: 7 lwa32
2012-08-09 06:04:29 [INFO    ] DP 1: 8 lwa11
2012-08-09 06:04:29 [INFO    ] DP 1: 9 lwa30
2012-08-09 06:04:29 [INFO    ] DP 1: 10 lwa12
2012-08-09 06:04:29 [INFO    ] DP 1: 11 lwa8
2012-08-09 06:04:29 [INFO    ] DP 1: 12 lwa13
2012-08-09 06:04:29 [INFO    ] DP 1: 13 lwa26
2012-08-09 06:04:29 [INFO    ] DP 1: 14 lwa14
2012-08-09 06:04:29 [INFO    ] DP 1: 16 lwa22
2012-08-09 06:04:29 [INFO    ] DP 1: 17 lwa20
2012-08-09 06:04:29 [INFO    ] DP 1: 18 lwa1
2012-08-09 06:04:29 [INFO    ] DP 1: 19 lwa5
2012-08-09 06:04:29 [INFO    ] DP 1: 20 lwa25
2012-08-09 06:04:29 [INFO    ] DP 1: 21 lwa35
2012-08-09 06:04:29 [INFO    ] DP 1: 22 lwa19
2012-08-09 06:04:29 [INFO    ] DP 1: 23 lwa21
2012-08-09 06:04:29 [INFO    ] DP 1: 24 lwa6
2012-08-09 06:04:29 [INFO    ] DP 1: 25 lwa7
2012-08-09 06:04:29 [INFO    ] DP 1: 26 lwa33
2012-08-09 06:04:29 [INFO    ] DP 1: 27 lwa15
2012-08-09 06:04:29 [INFO    ] DP 1: 28 lwa28
2012-08-09 06:04:29 [INFO    ] DP 2: 1 lwa16
2012-08-09 06:04:29 [INFO    ] DP 2: 15 lwa34
2012-08-09 06:04:29 [INFO    ] Total of 28 boards
2012-08-09 06:04:29 [INFO    ] Total of 260 stands
2012-08-09 06:04:29 [INFO    ] -------------------
2012-08-09 06:04:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8195
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8196
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8197
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8198
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8199
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8200
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8201
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8202
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8203
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8204
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8205
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8206
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8207
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8208
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8209
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8210
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8211
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8212
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8213
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8214
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8215
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8216
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8217
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8218
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8219
2012-08-09 06:04:36 [DEBUG   ] 2012-08-09 06:04:36 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 8220
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8195 exited with status 0
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8196 exited with status 0
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8197 exited with status 0
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8198 exited with status 0
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8199 exited with status 0
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8200 exited with status 0
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8201 exited with status 0
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8202 exited with status 0
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8203 exited with status 0
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8204 exited with status 0
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8205 exited with status 0
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8206 exited with status 0
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8207 exited with status 0
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8208 exited with status 0
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8209 exited with status 0
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8210 exited with status 0
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8211 exited with status 0
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8212 exited with status 0
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8213 exited with status 0
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8214 exited with status 0
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8215 exited with status 0
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8216 exited with status 0
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8217 exited with status 0
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8218 exited with status 0
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8219 exited with status 0
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 8220 exited with status 0
2012-08-09 06:04:48 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] spawn_process: at 2012-08-09 06:04:48 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 8247
2012-08-09 06:04:48 [DEBUG   ] 2012-08-09 06:04:48 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 8248
2012-08-09 06:04:54 [DEBUG   ] 2012-08-09 06:04:54 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 8247 exited with status 0
2012-08-09 06:04:54 [DEBUG   ] 2012-08-09 06:04:54 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 8248 exited with status 0
2012-08-09 06:04:54 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2012-08-09 06:04:54 [DEBUG   ] spawn_process: at 2012-08-09 06:04:54 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2012-08-09 06:04:54 [DEBUG   ] spawn_process: at 2012-08-09 06:04:54 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2012-08-09 06:04:54 [INFO    ] Setting Beam 1 xbars
2012-08-09 06:04:54 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2012-08-09 06:04:54 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2012-08-09 06:04:54 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2012-08-09 06:04:54 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2012-08-09 06:04:54 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2012-08-09 06:04:55 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2012-08-09 06:04:55 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2012-08-09 06:04:55 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2012-08-09 06:04:55 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2012-08-09 06:04:55 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2012-08-09 06:04:55 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2012-08-09 06:04:55 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2012-08-09 06:04:55 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2012-08-09 06:04:55 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2012-08-09 06:04:56 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2012-08-09 06:04:56 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2012-08-09 06:04:56 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2012-08-09 06:04:56 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2012-08-09 06:04:56 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2012-08-09 06:04:56 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2012-08-09 06:04:56 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2012-08-09 06:04:56 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2012-08-09 06:04:56 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2012-08-09 06:04:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2012-08-09 06:04:57 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2012-08-09 06:04:57 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2012-08-09 06:04:57 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2012-08-09 06:04:57 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2012-08-09 06:04:57 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2012-08-09 06:04:57 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2012-08-09 06:04:57 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2012-08-09 06:04:57 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2012-08-09 06:04:57 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2012-08-09 06:04:58 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2012-08-09 06:04:58 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2012-08-09 06:04:58 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2012-08-09 06:04:58 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2012-08-09 06:04:58 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2012-08-09 06:04:58 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2012-08-09 06:04:58 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2012-08-09 06:04:58 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2012-08-09 06:04:58 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2012-08-09 06:04:59 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2012-08-09 06:04:59 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2012-08-09 06:04:59 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2012-08-09 06:04:59 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2012-08-09 06:04:59 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2012-08-09 06:04:59 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2012-08-09 06:04:59 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2012-08-09 06:04:59 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2012-08-09 06:04:59 [INFO    ] Setting Beam 2 xbars
2012-08-09 06:04:59 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2012-08-09 06:05:00 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2012-08-09 06:05:00 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2012-08-09 06:05:00 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2012-08-09 06:05:00 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2012-08-09 06:05:00 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2012-08-09 06:05:00 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2012-08-09 06:05:00 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2012-08-09 06:05:00 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2012-08-09 06:05:00 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2012-08-09 06:05:01 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2012-08-09 06:05:01 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2012-08-09 06:05:01 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2012-08-09 06:05:01 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2012-08-09 06:05:01 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2012-08-09 06:05:01 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2012-08-09 06:05:01 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2012-08-09 06:05:01 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2012-08-09 06:05:01 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2012-08-09 06:05:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2012-08-09 06:05:02 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2012-08-09 06:05:02 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2012-08-09 06:05:02 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2012-08-09 06:05:02 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2012-08-09 06:05:02 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2012-08-09 06:05:02 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2012-08-09 06:05:02 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2012-08-09 06:05:02 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2012-08-09 06:05:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2012-08-09 06:05:03 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2012-08-09 06:05:03 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2012-08-09 06:05:03 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2012-08-09 06:05:03 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2012-08-09 06:05:03 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2012-08-09 06:05:03 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2012-08-09 06:05:03 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2012-08-09 06:05:03 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2012-08-09 06:05:03 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2012-08-09 06:05:04 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2012-08-09 06:05:04 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2012-08-09 06:05:04 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2012-08-09 06:05:04 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2012-08-09 06:05:04 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2012-08-09 06:05:04 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2012-08-09 06:05:04 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2012-08-09 06:05:04 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2012-08-09 06:05:04 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2012-08-09 06:05:05 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2012-08-09 06:05:05 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2012-08-09 06:05:05 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2012-08-09 06:05:05 [INFO    ] Setting Beam 3 xbars
2012-08-09 06:05:05 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2012-08-09 06:05:05 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2012-08-09 06:05:05 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2012-08-09 06:05:05 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2012-08-09 06:05:05 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2012-08-09 06:05:05 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2012-08-09 06:05:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2012-08-09 06:05:06 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2012-08-09 06:05:06 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2012-08-09 06:05:06 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2012-08-09 06:05:06 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2012-08-09 06:05:06 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2012-08-09 06:05:06 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2012-08-09 06:05:06 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2012-08-09 06:05:06 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2012-08-09 06:05:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2012-08-09 06:05:07 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2012-08-09 06:05:07 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2012-08-09 06:05:07 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2012-08-09 06:05:07 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2012-08-09 06:05:07 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2012-08-09 06:05:07 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2012-08-09 06:05:07 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2012-08-09 06:05:07 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2012-08-09 06:05:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2012-08-09 06:05:08 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2012-08-09 06:05:08 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2012-08-09 06:05:08 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2012-08-09 06:05:08 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2012-08-09 06:05:08 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2012-08-09 06:05:08 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2012-08-09 06:05:08 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2012-08-09 06:05:08 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2012-08-09 06:05:08 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2012-08-09 06:05:09 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2012-08-09 06:05:10 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2012-08-09 06:05:10 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2012-08-09 06:05:10 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2012-08-09 06:05:10 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2012-08-09 06:05:10 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2012-08-09 06:05:10 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2012-08-09 06:05:10 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2012-08-09 06:05:10 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2012-08-09 06:05:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2012-08-09 06:05:10 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2012-08-09 06:05:11 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2012-08-09 06:05:11 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2012-08-09 06:05:11 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2012-08-09 06:05:11 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2012-08-09 06:05:11 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2012-08-09 06:05:11 [INFO    ] Setting Beam 4 xbars
2012-08-09 06:05:11 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2012-08-09 06:05:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-09 06:05:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-09 06:05:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2012-08-09 06:05:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2012-08-09 06:05:12 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2012-08-09 06:05:12 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2012-08-09 06:05:12 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2012-08-09 06:05:12 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2012-08-09 06:05:12 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2012-08-09 06:05:12 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2012-08-09 06:05:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2012-08-09 06:05:13 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2012-08-09 06:05:13 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2012-08-09 06:05:13 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2012-08-09 06:05:13 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2012-08-09 06:05:13 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2012-08-09 06:05:13 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2012-08-09 06:05:13 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2012-08-09 06:05:13 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2012-08-09 06:05:13 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2012-08-09 06:05:13 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2012-08-09 06:05:14 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2012-08-09 06:05:14 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2012-08-09 06:05:14 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2012-08-09 06:05:14 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2012-08-09 06:05:14 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2012-08-09 06:05:14 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2012-08-09 06:05:14 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2012-08-09 06:05:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2012-08-09 06:05:15 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2012-08-09 06:05:15 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2012-08-09 06:05:15 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2012-08-09 06:05:15 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2012-08-09 06:05:15 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2012-08-09 06:05:15 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2012-08-09 06:05:15 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2012-08-09 06:05:15 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2012-08-09 06:05:15 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2012-08-09 06:05:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2012-08-09 06:05:16 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2012-08-09 06:05:16 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2012-08-09 06:05:16 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2012-08-09 06:05:16 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2012-08-09 06:05:16 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2012-08-09 06:05:16 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2012-08-09 06:05:16 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2012-08-09 06:05:16 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2012-08-09 06:05:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2012-08-09 06:05:17 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2012-08-09 06:05:17 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2012-08-09 06:05:17 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2012-08-09 06:05:17 [INFO    ] All xbars set
2012-08-09 06:05:17 [INFO    ] Setting adder chain routing for all beams
2012-08-09 06:05:22 [INFO    ] Setting beam ids
2012-08-09 06:05:32 [INFO    ] Starting beam delay calibration
2012-08-09 06:05:44 [INFO    ] Beam 1 latency is 5728
2012-08-09 06:05:44 [INFO    ] Beam 2 latency is 5768
2012-08-09 06:05:44 [INFO    ] Beam 3 latency is 5754
2012-08-09 06:05:44 [INFO    ] Beam 4 latency is 5730
2012-08-09 06:05:44 [INFO    ] Stop calibration
2012-08-09 06:05:52 [INFO    ] Beam delay calibration successful
2012-08-09 06:05:52 [INFO    ] Calibration passed
2012-08-09 06:05:52 [DEBUG   ] spawn_process: at 2012-08-09 06:05:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2012-08-09 06:05:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2012-08-09 06:05:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2012-08-09 06:05:52 [DEBUG   ] spawn_process: at 2012-08-09 06:05:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2012-08-09 06:05:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2012-08-09 06:05:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2012-08-09 06:05:52 [DEBUG   ] spawn_process: at 2012-08-09 06:05:52 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2012-08-09 06:05:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2012-08-09 06:05:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2012-08-09 06:05:52 [DEBUG   ] spawn_process: at 2012-08-09 06:05:52 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2012-08-09 06:05:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2012-08-09 06:05:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2012-08-09 06:05:53 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2012-08-09 06:05:53 [INFO    ] Started antennas statistics background thread
2012-08-09 06:05:53 [INFO    ] Started board flags background thread
2012-08-09 06:05:53 [INFO    ] Started BAM background thread
2012-08-09 06:05:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 with PID 9844
2012-08-09 06:05:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 with PID 9847
2012-08-09 06:05:53 [INFO    ] Finished the INI process in 101.403 s
2012-08-09 06:05:54 [DEBUG   ] Finished updating board flags in 0.830 seconds
2012-08-09 06:06:12 [DEBUG   ] Got command RPT from MCS: ref #9252
2012-08-09 06:06:12 [DEBUG   ] summary = NORMAL
2012-08-09 06:06:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9252  14 56148 21972297 A NORMALNORMAL'
2012-08-09 06:06:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 06:06:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 06:06:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 06:06:54 [DEBUG   ] Finished updating board flags in 0.841 seconds
2012-08-09 06:07:13 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 06:07:17 [DEBUG   ] Got command TBN from MCS: ref #9257
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '1', '1344492439']
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '2', '1344492439']
2012-08-09 06:07:17 [DEBUG   ] tbn = exited with status True, code 0x00
2012-08-09 06:07:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN     9257   8 56148 22037613 A NORMAL'
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '3', '1344492439']
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '4', '1344492439']
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '5', '1344492439']
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '6', '1344492439']
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '7', '1344492439']
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '8', '1344492439']
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '9', '1344492439']
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '10', '1344492439']
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '11', '1344492439']
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '12', '1344492439']
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '13', '1344492439']
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '14', '1344492439']
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '15', '1344492439']
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '16', '1344492439']
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '17', '1344492439']
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '18', '1344492439']
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '19', '1344492439']
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '20', '1344492439']
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '21', '1344492439']
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '22', '1344492439']
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '23', '1344492439']
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '24', '1344492439']
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '25', '1344492439']
2012-08-09 06:07:17 [DEBUG   ] spawn_process: at 2012-08-09 06:07:17 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '52000000.0', '7', '18', '0', '26', '1344492439']
2012-08-09 06:07:17 [INFO    ] Finished spawning TBN in 0.047 s
2012-08-09 06:07:33 [DEBUG   ] Finished updating ant stats in 0.671 seconds
2012-08-09 06:07:53 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 06:07:54 [DEBUG   ] Finished updating board flags in 1.225 seconds
2012-08-09 06:08:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 06:08:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 06:08:53 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 06:08:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2012-08-09 06:08:54 [CRITICAL] MGT underflow detected on beam(s) 1
2012-08-09 06:08:54 [DEBUG   ] Finished updating board flags in 1.239 seconds
2012-08-09 06:09:06 [DEBUG   ] Got command RPT from MCS: ref #9258
2012-08-09 06:09:06 [DEBUG   ] summary = ERROR
2012-08-09 06:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9258  13 56148 22146413 A  ERRORERROR'
2012-08-09 06:09:06 [DEBUG   ] Got command RPT from MCS: ref #9259
2012-08-09 06:09:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 06:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9259  77 56148 22146413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 06:09:13 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2012-08-09 06:09:34 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2012-08-09 06:09:54 [DEBUG   ] Finished updating ant stats in 1.243 seconds
2012-08-09 06:09:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2012-08-09 06:09:54 [DEBUG   ] Finished updating board flags in 1.293 seconds
2012-08-09 06:10:14 [DEBUG   ] Finished updating ant stats in 1.165 seconds
2012-08-09 06:10:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 06:10:54 [DEBUG   ] Finished updating ant stats in 1.043 seconds
2012-08-09 06:10:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 06:10:55 [DEBUG   ] Finished updating board flags in 1.435 seconds
2012-08-09 06:11:14 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2012-08-09 06:11:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 06:11:54 [DEBUG   ] Finished updating ant stats in 0.841 seconds
2012-08-09 06:11:55 [DEBUG   ] Finished updating board flags in 1.389 seconds
2012-08-09 06:12:14 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2012-08-09 06:12:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 06:12:55 [DEBUG   ] Finished updating board flags in 1.351 seconds
2012-08-09 06:12:55 [DEBUG   ] Finished updating ant stats in 1.438 seconds
2012-08-09 06:13:15 [DEBUG   ] Finished updating ant stats in 1.362 seconds
2012-08-09 06:13:35 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 06:13:55 [DEBUG   ] Finished updating ant stats in 1.239 seconds
2012-08-09 06:13:55 [DEBUG   ] Finished updating board flags in 1.350 seconds
2012-08-09 06:14:06 [DEBUG   ] Got command RPT from MCS: ref #9275
2012-08-09 06:14:06 [DEBUG   ] summary = ERROR
2012-08-09 06:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9275  13 56148 22446413 A  ERRORERROR'
2012-08-09 06:14:06 [DEBUG   ] Got command RPT from MCS: ref #9276
2012-08-09 06:14:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 06:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9276  77 56148 22446413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 06:14:15 [DEBUG   ] Finished updating ant stats in 1.165 seconds
2012-08-09 06:14:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 06:14:55 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2012-08-09 06:14:55 [DEBUG   ] Finished updating board flags in 1.605 seconds
2012-08-09 06:15:15 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2012-08-09 06:15:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 06:15:55 [DEBUG   ] Finished updating ant stats in 0.638 seconds
2012-08-09 06:15:55 [DEBUG   ] Finished updating board flags in 1.316 seconds
2012-08-09 06:16:15 [DEBUG   ] Finished updating ant stats in 0.564 seconds
2012-08-09 06:16:36 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-09 06:16:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2012-08-09 06:16:56 [DEBUG   ] Finished updating board flags in 1.803 seconds
2012-08-09 06:16:56 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2012-08-09 06:17:15 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-09 06:17:36 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2012-08-09 06:17:55 [DEBUG   ] Finished updating board flags in 1.457 seconds
2012-08-09 06:17:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 06:18:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 06:18:36 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-09 06:18:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 06:18:56 [DEBUG   ] Finished updating board flags in 2.350 seconds
2012-08-09 06:19:06 [DEBUG   ] Got command RPT from MCS: ref #9292
2012-08-09 06:19:06 [DEBUG   ] summary = ERROR
2012-08-09 06:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9292  13 56148 22746409 A  ERRORERROR'
2012-08-09 06:19:06 [DEBUG   ] Got command RPT from MCS: ref #9293
2012-08-09 06:19:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 06:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9293  77 56148 22746409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 06:19:16 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2012-08-09 06:19:36 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2012-08-09 06:19:55 [DEBUG   ] Finished updating board flags in 1.383 seconds
2012-08-09 06:19:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 06:20:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 06:20:36 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 06:20:56 [DEBUG   ] Finished updating board flags in 1.534 seconds
2012-08-09 06:20:56 [DEBUG   ] Finished updating ant stats in 0.637 seconds
2012-08-09 06:21:16 [DEBUG   ] Finished updating ant stats in 0.565 seconds
2012-08-09 06:21:37 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2012-08-09 06:21:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 06:21:57 [DEBUG   ] Finished updating board flags in 2.489 seconds
2012-08-09 06:21:57 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2012-08-09 06:22:17 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2012-08-09 06:22:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 06:22:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa34, chip 1
2012-08-09 06:22:56 [DEBUG   ] Finished updating board flags in 1.325 seconds
2012-08-09 06:22:57 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2012-08-09 06:23:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 06:23:37 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 06:23:56 [DEBUG   ] Finished updating board flags in 1.341 seconds
2012-08-09 06:23:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 06:24:06 [DEBUG   ] Got command RPT from MCS: ref #9309
2012-08-09 06:24:06 [DEBUG   ] summary = ERROR
2012-08-09 06:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9309  13 56148 23046413 A  ERRORERROR'
2012-08-09 06:24:06 [DEBUG   ] Got command RPT from MCS: ref #9310
2012-08-09 06:24:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 06:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9310  77 56148 23046413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 06:24:17 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 06:24:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 06:24:56 [DEBUG   ] Finished updating board flags in 1.340 seconds
2012-08-09 06:24:57 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-09 06:25:26 [DEBUG   ] Finished updating ant stats in 9.402 seconds
2012-08-09 06:25:42 [DEBUG   ] Finished updating ant stats in 5.400 seconds
2012-08-09 06:26:02 [DEBUG   ] Finished updating ant stats in 5.202 seconds
2012-08-09 06:26:21 [DEBUG   ] Finished updating ant stats in 4.201 seconds
2012-08-09 06:26:39 [DEBUG   ] Finished updating ant stats in 2.226 seconds
2012-08-09 06:26:41 [DEBUG   ] Finished updating board flags in 46.146 seconds
2012-08-09 06:26:56 [DEBUG   ] Finished updating board flags in 1.240 seconds
2012-08-09 06:26:58 [DEBUG   ] Finished updating ant stats in 1.175 seconds
2012-08-09 06:27:18 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2012-08-09 06:27:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 06:27:56 [DEBUG   ] Finished updating board flags in 1.295 seconds
2012-08-09 06:27:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 06:28:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 06:28:38 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 06:28:56 [DEBUG   ] Finished updating board flags in 1.301 seconds
2012-08-09 06:28:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 06:29:06 [DEBUG   ] Got command RPT from MCS: ref #9326
2012-08-09 06:29:06 [DEBUG   ] summary = ERROR
2012-08-09 06:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9326  13 56148 23346417 A  ERRORERROR'
2012-08-09 06:29:06 [DEBUG   ] Got command RPT from MCS: ref #9327
2012-08-09 06:29:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 06:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9327  77 56148 23346417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 06:29:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 06:29:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 06:29:57 [DEBUG   ] Finished updating board flags in 1.438 seconds
2012-08-09 06:29:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 06:30:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 06:30:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 06:30:57 [DEBUG   ] Finished updating board flags in 1.375 seconds
2012-08-09 06:30:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 06:31:19 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-09 06:31:39 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 06:31:57 [DEBUG   ] Finished updating board flags in 1.292 seconds
2012-08-09 06:31:59 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-09 06:32:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 06:32:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 06:32:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 06:32:57 [DEBUG   ] Finished updating board flags in 1.282 seconds
2012-08-09 06:32:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 06:33:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 06:33:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 06:33:57 [DEBUG   ] Finished updating board flags in 1.285 seconds
2012-08-09 06:33:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 06:34:06 [DEBUG   ] Got command RPT from MCS: ref #9343
2012-08-09 06:34:06 [DEBUG   ] summary = ERROR
2012-08-09 06:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9343  13 56148 23646413 A  ERRORERROR'
2012-08-09 06:34:06 [DEBUG   ] Got command RPT from MCS: ref #9344
2012-08-09 06:34:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 06:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9344  77 56148 23646413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 06:34:19 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 06:34:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 06:34:57 [DEBUG   ] Finished updating board flags in 1.279 seconds
2012-08-09 06:34:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 06:35:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 06:35:39 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 06:35:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 06:35:57 [DEBUG   ] Finished updating board flags in 1.317 seconds
2012-08-09 06:35:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 06:36:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 06:36:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 06:36:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 06:36:57 [DEBUG   ] Finished updating board flags in 1.473 seconds
2012-08-09 06:36:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 06:37:20 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2012-08-09 06:37:40 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-09 06:37:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 06:37:57 [DEBUG   ] Finished updating board flags in 1.279 seconds
2012-08-09 06:38:00 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-09 06:38:20 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 06:38:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 06:38:57 [DEBUG   ] Finished updating board flags in 1.234 seconds
2012-08-09 06:39:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 06:39:06 [DEBUG   ] Got command RPT from MCS: ref #9360
2012-08-09 06:39:06 [DEBUG   ] summary = ERROR
2012-08-09 06:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9360  13 56148 23946417 A  ERRORERROR'
2012-08-09 06:39:06 [DEBUG   ] Got command RPT from MCS: ref #9361
2012-08-09 06:39:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 06:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9361  77 56148 23946417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 06:39:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 06:39:40 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-09 06:39:57 [DEBUG   ] Finished updating board flags in 1.225 seconds
2012-08-09 06:40:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 06:40:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 06:40:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 06:40:57 [DEBUG   ] Finished updating board flags in 1.265 seconds
2012-08-09 06:41:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 06:41:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 06:41:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 06:41:57 [DEBUG   ] Finished updating board flags in 1.260 seconds
2012-08-09 06:42:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 06:42:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 06:42:40 [DEBUG   ] Finished updating ant stats in 0.498 seconds
2012-08-09 06:42:58 [DEBUG   ] Finished updating board flags in 1.458 seconds
2012-08-09 06:43:00 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-09 06:43:21 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-09 06:43:41 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-09 06:43:58 [DEBUG   ] Finished updating board flags in 1.408 seconds
2012-08-09 06:44:01 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 06:44:06 [DEBUG   ] Got command RPT from MCS: ref #9377
2012-08-09 06:44:06 [DEBUG   ] summary = ERROR
2012-08-09 06:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9377  13 56148 24246421 A  ERRORERROR'
2012-08-09 06:44:06 [DEBUG   ] Got command RPT from MCS: ref #9378
2012-08-09 06:44:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 06:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9378  77 56148 24246421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 06:44:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 06:44:41 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2012-08-09 06:44:58 [DEBUG   ] Finished updating board flags in 1.368 seconds
2012-08-09 06:45:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 06:45:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 06:45:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 06:45:58 [DEBUG   ] Finished updating board flags in 1.244 seconds
2012-08-09 06:46:01 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2012-08-09 06:46:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 06:46:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 06:46:58 [DEBUG   ] Finished updating board flags in 1.244 seconds
2012-08-09 06:47:01 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2012-08-09 06:47:22 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2012-08-09 06:47:41 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2012-08-09 06:47:58 [DEBUG   ] Finished updating board flags in 1.245 seconds
2012-08-09 06:48:02 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2012-08-09 06:48:22 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-09 06:48:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 06:48:58 [DEBUG   ] Finished updating board flags in 1.247 seconds
2012-08-09 06:49:02 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 06:49:06 [DEBUG   ] Got command RPT from MCS: ref #9394
2012-08-09 06:49:06 [DEBUG   ] summary = ERROR
2012-08-09 06:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9394  13 56148 24546413 A  ERRORERROR'
2012-08-09 06:49:06 [DEBUG   ] Got command RPT from MCS: ref #9395
2012-08-09 06:49:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 06:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9395  77 56148 24546413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 06:49:22 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 06:49:42 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-09 06:49:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa34, chip 1
2012-08-09 06:49:58 [DEBUG   ] Finished updating board flags in 1.253 seconds
2012-08-09 06:50:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 06:50:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 06:50:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 06:50:58 [DEBUG   ] Finished updating board flags in 1.250 seconds
2012-08-09 06:51:02 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 06:51:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 06:51:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 06:51:58 [DEBUG   ] Finished updating board flags in 1.252 seconds
2012-08-09 06:52:02 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 06:52:22 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2012-08-09 06:52:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 06:52:58 [DEBUG   ] Finished updating board flags in 1.243 seconds
2012-08-09 06:53:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 06:53:22 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 06:53:42 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-09 06:53:58 [DEBUG   ] Finished updating board flags in 1.248 seconds
2012-08-09 06:54:03 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 06:54:06 [DEBUG   ] Got command RPT from MCS: ref #9411
2012-08-09 06:54:06 [DEBUG   ] summary = ERROR
2012-08-09 06:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9411  13 56148 24846429 A  ERRORERROR'
2012-08-09 06:54:06 [DEBUG   ] Got command RPT from MCS: ref #9412
2012-08-09 06:54:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 06:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9412  77 56148 24846429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 06:54:23 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-09 06:54:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 06:54:58 [DEBUG   ] Finished updating board flags in 1.438 seconds
2012-08-09 06:55:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 06:55:23 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 06:55:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 06:55:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 06:55:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 06:55:58 [DEBUG   ] Finished updating board flags in 1.352 seconds
2012-08-09 06:56:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 06:56:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 06:56:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 06:56:58 [DEBUG   ] Finished updating board flags in 1.248 seconds
2012-08-09 06:57:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 06:57:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 06:57:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 06:57:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 06:57:58 [DEBUG   ] Finished updating board flags in 1.245 seconds
2012-08-09 06:58:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 06:58:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 06:58:43 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 06:58:58 [DEBUG   ] Finished updating board flags in 1.248 seconds
2012-08-09 06:59:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 06:59:06 [DEBUG   ] Got command RPT from MCS: ref #9428
2012-08-09 06:59:06 [DEBUG   ] summary = ERROR
2012-08-09 06:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9428  13 56148 25146417 A  ERRORERROR'
2012-08-09 06:59:06 [DEBUG   ] Got command RPT from MCS: ref #9429
2012-08-09 06:59:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 06:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9429  77 56148 25146417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 06:59:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 06:59:44 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2012-08-09 06:59:58 [DEBUG   ] Finished updating board flags in 1.249 seconds
2012-08-09 07:00:03 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-09 07:00:24 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 07:00:44 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2012-08-09 07:00:59 [DEBUG   ] Finished updating board flags in 1.430 seconds
2012-08-09 07:01:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 07:01:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 07:01:44 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 07:01:59 [DEBUG   ] Finished updating board flags in 1.391 seconds
2012-08-09 07:02:04 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-09 07:02:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 07:02:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 07:02:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 07:02:59 [DEBUG   ] Finished updating board flags in 1.254 seconds
2012-08-09 07:03:04 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2012-08-09 07:03:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 07:03:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 07:03:59 [DEBUG   ] Finished updating board flags in 1.249 seconds
2012-08-09 07:04:04 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2012-08-09 07:04:06 [DEBUG   ] Got command RPT from MCS: ref #9445
2012-08-09 07:04:06 [DEBUG   ] summary = ERROR
2012-08-09 07:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9445  13 56148 25446421 A  ERRORERROR'
2012-08-09 07:04:06 [DEBUG   ] Got command RPT from MCS: ref #9446
2012-08-09 07:04:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 07:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9446  77 56148 25446421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 07:04:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 07:04:45 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-09 07:04:59 [DEBUG   ] Finished updating board flags in 1.248 seconds
2012-08-09 07:05:04 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-09 07:05:25 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 07:05:45 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2012-08-09 07:05:59 [DEBUG   ] Finished updating board flags in 1.252 seconds
2012-08-09 07:06:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 07:06:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 07:06:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 07:06:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 07:06:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2012-08-09 07:06:59 [CRITICAL] MGT underflow detected on beam(s) 1
2012-08-09 07:06:59 [DEBUG   ] Finished updating board flags in 1.244 seconds
2012-08-09 07:07:05 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 07:07:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 07:07:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 07:07:59 [DEBUG   ] Finished updating board flags in 1.250 seconds
2012-08-09 07:08:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 07:08:25 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 07:08:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 07:08:59 [DEBUG   ] Finished updating board flags in 1.250 seconds
2012-08-09 07:09:05 [DEBUG   ] Finished updating ant stats in 0.500 seconds
2012-08-09 07:09:06 [DEBUG   ] Got command RPT from MCS: ref #9462
2012-08-09 07:09:06 [DEBUG   ] summary = ERROR
2012-08-09 07:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9462  13 56148 25746425 A  ERRORERROR'
2012-08-09 07:09:06 [DEBUG   ] Got command RPT from MCS: ref #9463
2012-08-09 07:09:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 07:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9463  77 56148 25746425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 07:09:26 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 07:09:46 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2012-08-09 07:09:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa34, chip 1
2012-08-09 07:09:59 [DEBUG   ] Finished updating board flags in 1.259 seconds
2012-08-09 07:10:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 07:10:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 07:10:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 07:10:59 [DEBUG   ] Finished updating board flags in 1.443 seconds
2012-08-09 07:11:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 07:11:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 07:11:46 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 07:11:59 [DEBUG   ] Finished updating board flags in 1.448 seconds
2012-08-09 07:12:06 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 07:12:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 07:12:46 [DEBUG   ] Finished updating ant stats in 0.592 seconds
2012-08-09 07:12:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 07:12:59 [DEBUG   ] Finished updating board flags in 1.328 seconds
2012-08-09 07:13:06 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2012-08-09 07:13:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 07:13:47 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2012-08-09 07:13:59 [DEBUG   ] Finished updating board flags in 1.234 seconds
2012-08-09 07:14:06 [DEBUG   ] Got command RPT from MCS: ref #9479
2012-08-09 07:14:06 [DEBUG   ] summary = ERROR
2012-08-09 07:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9479  13 56148 26046429 A  ERRORERROR'
2012-08-09 07:14:06 [DEBUG   ] Got command RPT from MCS: ref #9480
2012-08-09 07:14:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 07:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9480  77 56148 26046429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 07:14:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 07:14:27 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-09 07:14:47 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2012-08-09 07:14:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 07:14:59 [DEBUG   ] Finished updating board flags in 1.226 seconds
2012-08-09 07:15:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 07:15:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 07:15:47 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 07:15:59 [DEBUG   ] Finished updating board flags in 1.229 seconds
2012-08-09 07:16:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 07:16:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 07:16:48 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-09 07:16:59 [DEBUG   ] Finished updating board flags in 1.220 seconds
2012-08-09 07:17:07 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-09 07:17:28 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 07:17:48 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2012-08-09 07:17:59 [DEBUG   ] Finished updating board flags in 1.228 seconds
2012-08-09 07:18:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 07:18:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 07:18:48 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2012-08-09 07:18:59 [DEBUG   ] Finished updating board flags in 1.224 seconds
2012-08-09 07:19:06 [DEBUG   ] Got command RPT from MCS: ref #9496
2012-08-09 07:19:06 [DEBUG   ] summary = ERROR
2012-08-09 07:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9496  13 56148 26346416 A  ERRORERROR'
2012-08-09 07:19:06 [DEBUG   ] Got command RPT from MCS: ref #9497
2012-08-09 07:19:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 07:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9497  77 56148 26346417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 07:19:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 07:19:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 07:19:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 07:19:59 [DEBUG   ] Finished updating board flags in 1.229 seconds
2012-08-09 07:20:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 07:20:28 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 07:20:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 07:21:00 [DEBUG   ] Finished updating board flags in 1.418 seconds
2012-08-09 07:21:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 07:21:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 07:21:49 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-09 07:22:00 [DEBUG   ] Finished updating board flags in 1.423 seconds
2012-08-09 07:22:08 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-09 07:22:29 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 07:22:49 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-09 07:22:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 07:23:00 [DEBUG   ] Finished updating board flags in 1.403 seconds
2012-08-09 07:23:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 07:23:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 07:23:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 07:24:00 [DEBUG   ] Finished updating board flags in 1.391 seconds
2012-08-09 07:24:06 [DEBUG   ] Got command RPT from MCS: ref #9513
2012-08-09 07:24:06 [DEBUG   ] summary = ERROR
2012-08-09 07:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9513  13 56148 26646421 A  ERRORERROR'
2012-08-09 07:24:06 [DEBUG   ] Got command RPT from MCS: ref #9514
2012-08-09 07:24:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 07:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9514  77 56148 26646421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 07:24:09 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2012-08-09 07:24:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 07:24:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 07:25:00 [DEBUG   ] Finished updating board flags in 1.232 seconds
2012-08-09 07:25:09 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 07:25:29 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 07:25:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 07:26:00 [DEBUG   ] Finished updating board flags in 1.230 seconds
2012-08-09 07:26:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 07:26:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-09 07:26:50 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-09 07:27:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 07:27:00 [DEBUG   ] Finished updating board flags in 1.232 seconds
2012-08-09 07:27:09 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-09 07:27:30 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 07:27:50 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2012-08-09 07:28:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 07:28:00 [DEBUG   ] Finished updating board flags in 1.234 seconds
2012-08-09 07:28:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 07:28:30 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2012-08-09 07:28:50 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-09 07:29:00 [DEBUG   ] Finished updating board flags in 1.231 seconds
2012-08-09 07:29:06 [DEBUG   ] Got command RPT from MCS: ref #9530
2012-08-09 07:29:06 [DEBUG   ] summary = ERROR
2012-08-09 07:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9530  13 56148 26946428 A  ERRORERROR'
2012-08-09 07:29:06 [DEBUG   ] Got command RPT from MCS: ref #9531
2012-08-09 07:29:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 07:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9531  77 56148 26946429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 07:29:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 07:29:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 07:29:50 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2012-08-09 07:30:00 [DEBUG   ] Finished updating board flags in 1.230 seconds
2012-08-09 07:30:10 [DEBUG   ] Finished updating ant stats in 0.523 seconds
2012-08-09 07:30:30 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-09 07:30:51 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 07:31:00 [DEBUG   ] Finished updating board flags in 1.232 seconds
2012-08-09 07:31:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 07:31:31 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 07:31:51 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 07:32:00 [DEBUG   ] Finished updating board flags in 1.225 seconds
2012-08-09 07:32:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 07:32:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 07:32:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 07:33:00 [DEBUG   ] Finished updating board flags in 1.425 seconds
2012-08-09 07:33:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 07:33:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 07:33:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 07:34:00 [DEBUG   ] Finished updating board flags in 1.432 seconds
2012-08-09 07:34:06 [DEBUG   ] Got command RPT from MCS: ref #9547
2012-08-09 07:34:06 [DEBUG   ] summary = ERROR
2012-08-09 07:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9547  13 56148 27246437 A  ERRORERROR'
2012-08-09 07:34:06 [DEBUG   ] Got command RPT from MCS: ref #9548
2012-08-09 07:34:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 07:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9548  77 56148 27246437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 07:34:11 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 07:34:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 07:34:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 07:35:00 [DEBUG   ] Finished updating board flags in 1.453 seconds
2012-08-09 07:35:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 07:35:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 07:35:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 07:36:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 07:36:00 [DEBUG   ] Finished updating board flags in 1.453 seconds
2012-08-09 07:36:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 07:36:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-09 07:36:51 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-09 07:37:00 [DEBUG   ] Finished updating board flags in 1.648 seconds
2012-08-09 07:37:11 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-09 07:37:32 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2012-08-09 07:37:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 07:37:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 07:38:00 [DEBUG   ] Finished updating board flags in 1.612 seconds
2012-08-09 07:38:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 07:38:32 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2012-08-09 07:38:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 07:39:00 [DEBUG   ] Finished updating board flags in 1.340 seconds
2012-08-09 07:39:06 [DEBUG   ] Got command RPT from MCS: ref #9564
2012-08-09 07:39:06 [DEBUG   ] summary = ERROR
2012-08-09 07:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9564  13 56148 27546425 A  ERRORERROR'
2012-08-09 07:39:06 [DEBUG   ] Got command RPT from MCS: ref #9565
2012-08-09 07:39:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 07:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9565  77 56148 27546425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 07:39:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 07:39:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 07:39:52 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-09 07:40:00 [DEBUG   ] Finished updating board flags in 1.241 seconds
2012-08-09 07:40:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 07:40:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 07:40:52 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2012-08-09 07:40:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 07:41:00 [DEBUG   ] Finished updating board flags in 1.233 seconds
2012-08-09 07:41:12 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2012-08-09 07:41:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-09 07:41:52 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-09 07:42:00 [DEBUG   ] Finished updating board flags in 1.227 seconds
2012-08-09 07:42:13 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 07:42:33 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-09 07:42:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 07:43:00 [DEBUG   ] Finished updating board flags in 1.235 seconds
2012-08-09 07:43:13 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2012-08-09 07:43:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 07:43:53 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-09 07:44:00 [DEBUG   ] Finished updating board flags in 1.233 seconds
2012-08-09 07:44:06 [DEBUG   ] Got command RPT from MCS: ref #9581
2012-08-09 07:44:06 [DEBUG   ] summary = ERROR
2012-08-09 07:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9581  13 56148 27846428 A  ERRORERROR'
2012-08-09 07:44:06 [DEBUG   ] Got command RPT from MCS: ref #9582
2012-08-09 07:44:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 07:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9582  77 56148 27846429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 07:44:13 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 07:44:33 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2012-08-09 07:44:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 07:45:00 [DEBUG   ] Finished updating board flags in 1.231 seconds
2012-08-09 07:45:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 07:45:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 07:45:53 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2012-08-09 07:45:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 07:46:01 [DEBUG   ] Finished updating board flags in 1.431 seconds
2012-08-09 07:46:13 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2012-08-09 07:46:33 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-09 07:46:54 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 07:46:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 07:47:01 [DEBUG   ] Finished updating board flags in 1.406 seconds
2012-08-09 07:47:14 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-09 07:47:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 07:47:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 07:48:01 [DEBUG   ] Finished updating board flags in 1.390 seconds
2012-08-09 07:48:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 07:48:34 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2012-08-09 07:48:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 07:49:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 07:49:01 [DEBUG   ] Finished updating board flags in 1.254 seconds
2012-08-09 07:49:06 [DEBUG   ] Got command RPT from MCS: ref #9598
2012-08-09 07:49:06 [DEBUG   ] summary = ERROR
2012-08-09 07:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9598  13 56148 28146429 A  ERRORERROR'
2012-08-09 07:49:06 [DEBUG   ] Got command RPT from MCS: ref #9599
2012-08-09 07:49:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 07:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9599  77 56148 28146429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 07:49:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 07:49:35 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2012-08-09 07:49:55 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-09 07:50:01 [DEBUG   ] Finished updating board flags in 1.236 seconds
2012-08-09 07:50:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 07:50:35 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2012-08-09 07:50:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 07:51:01 [DEBUG   ] Finished updating board flags in 1.246 seconds
2012-08-09 07:51:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 07:51:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 07:51:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 07:52:01 [DEBUG   ] Finished updating board flags in 1.229 seconds
2012-08-09 07:52:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 07:52:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 07:52:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 07:53:01 [DEBUG   ] Finished updating board flags in 1.259 seconds
2012-08-09 07:53:15 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2012-08-09 07:53:35 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2012-08-09 07:53:56 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-09 07:54:01 [DEBUG   ] Finished updating board flags in 1.267 seconds
2012-08-09 07:54:06 [DEBUG   ] Got command RPT from MCS: ref #9615
2012-08-09 07:54:06 [DEBUG   ] summary = ERROR
2012-08-09 07:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9615  13 56148 28446437 A  ERRORERROR'
2012-08-09 07:54:06 [DEBUG   ] Got command RPT from MCS: ref #9616
2012-08-09 07:54:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 07:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9616  77 56148 28446437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 07:54:16 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 07:54:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 07:54:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 07:55:01 [DEBUG   ] Finished updating board flags in 1.653 seconds
2012-08-09 07:55:16 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2012-08-09 07:55:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 07:55:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 07:56:01 [DEBUG   ] Finished updating board flags in 1.190 seconds
2012-08-09 07:56:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 07:56:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 07:56:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 07:57:01 [DEBUG   ] Finished updating board flags in 1.311 seconds
2012-08-09 07:57:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 07:57:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 07:57:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 07:58:01 [DEBUG   ] Finished updating board flags in 1.248 seconds
2012-08-09 07:58:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 07:58:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 07:58:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 07:59:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 07:59:01 [DEBUG   ] Finished updating board flags in 1.249 seconds
2012-08-09 07:59:06 [DEBUG   ] Got command RPT from MCS: ref #9632
2012-08-09 07:59:06 [DEBUG   ] summary = ERROR
2012-08-09 07:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9632  13 56148 28746425 A  ERRORERROR'
2012-08-09 07:59:06 [DEBUG   ] Got command RPT from MCS: ref #9633
2012-08-09 07:59:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 07:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9633  77 56148 28746425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 07:59:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 07:59:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 07:59:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 08:00:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 08:00:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 08:00:02 [DEBUG   ] Finished updating board flags in 1.491 seconds
2012-08-09 08:00:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 08:00:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 08:00:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 08:01:02 [DEBUG   ] Finished updating board flags in 1.412 seconds
2012-08-09 08:01:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 08:01:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 08:01:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 08:02:02 [DEBUG   ] Finished updating board flags in 1.422 seconds
2012-08-09 08:02:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2012-08-09 08:02:37 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-09 08:02:57 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-09 08:03:02 [DEBUG   ] Finished updating board flags in 1.413 seconds
2012-08-09 08:03:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 08:03:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 08:03:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 08:04:02 [DEBUG   ] Finished updating board flags in 1.385 seconds
2012-08-09 08:04:06 [DEBUG   ] Got command RPT from MCS: ref #9649
2012-08-09 08:04:06 [DEBUG   ] summary = ERROR
2012-08-09 08:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9649  13 56148 29046433 A  ERRORERROR'
2012-08-09 08:04:06 [DEBUG   ] Got command RPT from MCS: ref #9650
2012-08-09 08:04:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 08:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9650  77 56148 29046433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 08:04:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 08:04:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 08:04:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 08:05:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 08:05:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 08:05:02 [DEBUG   ] Finished updating board flags in 1.363 seconds
2012-08-09 08:05:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 08:05:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 08:05:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 08:06:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 08:06:02 [DEBUG   ] Finished updating board flags in 1.422 seconds
2012-08-09 08:06:17 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 08:06:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 08:06:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 08:07:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 08:07:02 [DEBUG   ] Finished updating board flags in 1.423 seconds
2012-08-09 08:07:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 08:07:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 08:07:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 08:08:02 [DEBUG   ] Finished updating board flags in 1.440 seconds
2012-08-09 08:08:17 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2012-08-09 08:08:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 08:08:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 08:09:02 [DEBUG   ] Finished updating board flags in 1.439 seconds
2012-08-09 08:09:06 [DEBUG   ] Got command RPT from MCS: ref #9666
2012-08-09 08:09:06 [DEBUG   ] summary = ERROR
2012-08-09 08:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9666  13 56148 29346432 A  ERRORERROR'
2012-08-09 08:09:06 [DEBUG   ] Got command RPT from MCS: ref #9667
2012-08-09 08:09:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 08:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9667  77 56148 29346433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 08:09:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 08:09:37 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2012-08-09 08:09:57 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-09 08:10:02 [DEBUG   ] Finished updating board flags in 1.433 seconds
2012-08-09 08:10:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-09 08:10:38 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2012-08-09 08:10:58 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 08:11:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 08:11:02 [DEBUG   ] Finished updating board flags in 1.437 seconds
2012-08-09 08:11:18 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2012-08-09 08:11:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 08:11:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 08:12:02 [DEBUG   ] Finished updating board flags in 1.646 seconds
2012-08-09 08:12:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 08:12:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 08:12:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 08:13:02 [DEBUG   ] Finished updating board flags in 1.629 seconds
2012-08-09 08:13:18 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2012-08-09 08:13:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 08:13:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 08:14:02 [DEBUG   ] Finished updating board flags in 1.348 seconds
2012-08-09 08:14:06 [DEBUG   ] Got command RPT from MCS: ref #9683
2012-08-09 08:14:06 [DEBUG   ] summary = ERROR
2012-08-09 08:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9683  13 56148 29646433 A  ERRORERROR'
2012-08-09 08:14:06 [DEBUG   ] Got command RPT from MCS: ref #9684
2012-08-09 08:14:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 08:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9684  77 56148 29646433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 08:14:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 08:14:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 08:14:58 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 08:15:02 [DEBUG   ] Finished updating board flags in 1.253 seconds
2012-08-09 08:15:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 08:15:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 08:15:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 08:16:02 [DEBUG   ] Finished updating board flags in 1.257 seconds
2012-08-09 08:16:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 08:16:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 08:16:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 08:17:03 [DEBUG   ] Finished updating board flags in 1.769 seconds
2012-08-09 08:17:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 08:17:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 08:17:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 08:18:03 [DEBUG   ] Finished updating board flags in 1.401 seconds
2012-08-09 08:18:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 08:18:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 08:18:58 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 08:19:03 [DEBUG   ] Finished updating board flags in 1.446 seconds
2012-08-09 08:19:06 [DEBUG   ] Got command RPT from MCS: ref #9700
2012-08-09 08:19:06 [DEBUG   ] summary = ERROR
2012-08-09 08:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9700  13 56148 29946433 A  ERRORERROR'
2012-08-09 08:19:06 [DEBUG   ] Got command RPT from MCS: ref #9701
2012-08-09 08:19:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 08:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9701  77 56148 29946433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 08:19:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 08:19:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 08:19:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 08:20:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 08:20:03 [DEBUG   ] Finished updating board flags in 1.293 seconds
2012-08-09 08:20:18 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2012-08-09 08:20:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 08:20:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 08:21:03 [DEBUG   ] Finished updating board flags in 1.256 seconds
2012-08-09 08:21:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 08:21:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 08:21:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 08:22:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 08:22:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 08:22:03 [DEBUG   ] Finished updating board flags in 1.253 seconds
2012-08-09 08:22:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 08:22:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 08:22:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 08:23:03 [DEBUG   ] Finished updating board flags in 1.265 seconds
2012-08-09 08:23:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 08:23:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 08:23:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 08:24:03 [DEBUG   ] Finished updating board flags in 1.268 seconds
2012-08-09 08:24:06 [DEBUG   ] Got command RPT from MCS: ref #9717
2012-08-09 08:24:06 [DEBUG   ] summary = ERROR
2012-08-09 08:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9717  13 56148 30246429 A  ERRORERROR'
2012-08-09 08:24:06 [DEBUG   ] Got command RPT from MCS: ref #9718
2012-08-09 08:24:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 08:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9718  77 56148 30246429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 08:24:18 [DEBUG   ] Finished updating ant stats in 0.593 seconds
2012-08-09 08:24:39 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-09 08:24:59 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 08:25:03 [DEBUG   ] Finished updating board flags in 1.278 seconds
2012-08-09 08:25:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 08:25:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 08:25:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 08:26:03 [DEBUG   ] Finished updating board flags in 1.418 seconds
2012-08-09 08:26:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 08:26:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 08:26:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 08:27:03 [DEBUG   ] Finished updating board flags in 1.446 seconds
2012-08-09 08:27:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 08:27:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 08:27:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 08:28:03 [DEBUG   ] Finished updating board flags in 1.665 seconds
2012-08-09 08:28:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 08:28:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 08:28:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 08:29:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-09 08:29:03 [DEBUG   ] Finished updating board flags in 1.620 seconds
2012-08-09 08:29:06 [DEBUG   ] Got command RPT from MCS: ref #9734
2012-08-09 08:29:06 [DEBUG   ] summary = ERROR
2012-08-09 08:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9734  13 56148 30546441 A  ERRORERROR'
2012-08-09 08:29:06 [DEBUG   ] Got command RPT from MCS: ref #9735
2012-08-09 08:29:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 08:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9735  77 56148 30546441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 08:29:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 08:29:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 08:29:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 08:30:03 [DEBUG   ] Finished updating board flags in 1.347 seconds
2012-08-09 08:30:19 [DEBUG   ] Finished updating ant stats in 1.193 seconds
2012-08-09 08:30:39 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2012-08-09 08:30:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 08:31:03 [DEBUG   ] Finished updating board flags in 1.234 seconds
2012-08-09 08:31:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 08:31:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 08:31:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 08:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 08:32:03 [DEBUG   ] Finished updating board flags in 1.234 seconds
2012-08-09 08:32:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 08:32:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 08:32:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 08:33:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 08:33:03 [DEBUG   ] Finished updating board flags in 1.234 seconds
2012-08-09 08:33:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 08:33:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 08:33:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 08:34:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 08:34:03 [DEBUG   ] Finished updating board flags in 1.234 seconds
2012-08-09 08:34:06 [DEBUG   ] Got command RPT from MCS: ref #9751
2012-08-09 08:34:06 [DEBUG   ] summary = ERROR
2012-08-09 08:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9751  13 56148 30846437 A  ERRORERROR'
2012-08-09 08:34:06 [DEBUG   ] Got command RPT from MCS: ref #9752
2012-08-09 08:34:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 08:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9752  77 56148 30846437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 08:34:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 08:34:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 08:34:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 08:35:04 [DEBUG   ] Finished updating board flags in 1.569 seconds
2012-08-09 08:35:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 08:35:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 08:35:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 08:36:04 [DEBUG   ] Finished updating board flags in 1.293 seconds
2012-08-09 08:36:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 08:36:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 08:36:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 08:37:04 [DEBUG   ] Finished updating board flags in 1.337 seconds
2012-08-09 08:37:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 08:37:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 08:37:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 08:38:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 08:38:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2012-08-09 08:38:04 [DEBUG   ] Finished updating board flags in 1.354 seconds
2012-08-09 08:38:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 08:38:39 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2012-08-09 08:39:00 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2012-08-09 08:39:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 08:39:04 [DEBUG   ] Finished updating board flags in 1.356 seconds
2012-08-09 08:39:06 [DEBUG   ] Got command RPT from MCS: ref #9768
2012-08-09 08:39:06 [DEBUG   ] summary = ERROR
2012-08-09 08:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9768  13 56148 31146440 A  ERRORERROR'
2012-08-09 08:39:06 [DEBUG   ] Got command RPT from MCS: ref #9769
2012-08-09 08:39:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 08:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9769  77 56148 31146441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 08:39:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 08:39:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 08:40:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 08:40:04 [DEBUG   ] Finished updating board flags in 1.514 seconds
2012-08-09 08:40:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 08:40:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 08:41:00 [DEBUG   ] Finished updating ant stats in 1.050 seconds
2012-08-09 08:41:04 [DEBUG   ] Finished updating board flags in 1.253 seconds
2012-08-09 08:41:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 08:41:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 08:42:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 08:42:04 [DEBUG   ] Finished updating board flags in 1.226 seconds
2012-08-09 08:42:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 08:42:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 08:43:00 [DEBUG   ] Finished updating ant stats in 0.949 seconds
2012-08-09 08:43:04 [DEBUG   ] Finished updating board flags in 1.225 seconds
2012-08-09 08:43:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 08:43:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 08:44:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 08:44:04 [DEBUG   ] Finished updating board flags in 1.223 seconds
2012-08-09 08:44:06 [DEBUG   ] Got command RPT from MCS: ref #9785
2012-08-09 08:44:06 [DEBUG   ] summary = ERROR
2012-08-09 08:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9785  13 56148 31446441 A  ERRORERROR'
2012-08-09 08:44:06 [DEBUG   ] Got command RPT from MCS: ref #9786
2012-08-09 08:44:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 08:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9786  77 56148 31446441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 08:44:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 08:44:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 08:45:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 08:45:04 [DEBUG   ] Finished updating board flags in 1.339 seconds
2012-08-09 08:45:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 08:45:40 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2012-08-09 08:46:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 08:46:05 [DEBUG   ] Finished updating board flags in 1.493 seconds
2012-08-09 08:46:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 08:46:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 08:47:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 08:47:05 [DEBUG   ] Finished updating board flags in 1.447 seconds
2012-08-09 08:47:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 08:47:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 08:48:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 08:48:05 [DEBUG   ] Finished updating board flags in 1.473 seconds
2012-08-09 08:48:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 08:48:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 08:49:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa34, chip 1
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2012-08-09 08:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2012-08-09 08:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2012-08-09 08:49:05 [DEBUG   ] Finished updating board flags in 1.487 seconds
2012-08-09 08:49:06 [DEBUG   ] Got command RPT from MCS: ref #9802
2012-08-09 08:49:06 [DEBUG   ] summary = ERROR
2012-08-09 08:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9802  13 56148 31746436 A  ERRORERROR'
2012-08-09 08:49:06 [DEBUG   ] Got command RPT from MCS: ref #9803
2012-08-09 08:49:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 08:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9803  77 56148 31746437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 08:49:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 08:49:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 08:50:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2012-08-09 08:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2012-08-09 08:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2012-08-09 08:50:05 [DEBUG   ] Finished updating board flags in 1.484 seconds
2012-08-09 08:50:20 [DEBUG   ] Finished updating ant stats in 0.593 seconds
2012-08-09 08:50:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-09 08:51:00 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-09 08:51:05 [DEBUG   ] Finished updating board flags in 1.465 seconds
2012-08-09 08:51:20 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-09 08:51:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-09 08:52:01 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2012-08-09 08:52:05 [DEBUG   ] Finished updating board flags in 1.466 seconds
2012-08-09 08:52:21 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 08:52:41 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 08:53:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 08:53:05 [DEBUG   ] Finished updating board flags in 1.465 seconds
2012-08-09 08:53:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 08:53:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 08:54:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 08:54:05 [DEBUG   ] Finished updating board flags in 1.666 seconds
2012-08-09 08:54:06 [DEBUG   ] Got command RPT from MCS: ref #9819
2012-08-09 08:54:06 [DEBUG   ] summary = ERROR
2012-08-09 08:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9819  13 56148 32046437 A  ERRORERROR'
2012-08-09 08:54:06 [DEBUG   ] Got command RPT from MCS: ref #9820
2012-08-09 08:54:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 08:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9820  77 56148 32046437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 08:54:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 08:54:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 08:55:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 08:55:05 [DEBUG   ] Finished updating board flags in 1.639 seconds
2012-08-09 08:55:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 08:55:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 08:56:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 08:56:05 [DEBUG   ] Finished updating board flags in 1.330 seconds
2012-08-09 08:56:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 08:56:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 08:57:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 08:57:05 [DEBUG   ] Finished updating board flags in 1.237 seconds
2012-08-09 08:57:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 08:57:41 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2012-08-09 08:58:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 08:58:05 [DEBUG   ] Finished updating board flags in 1.243 seconds
2012-08-09 08:58:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 08:58:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 08:59:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 08:59:05 [DEBUG   ] Finished updating board flags in 1.241 seconds
2012-08-09 08:59:06 [DEBUG   ] Got command RPT from MCS: ref #9836
2012-08-09 08:59:06 [DEBUG   ] summary = ERROR
2012-08-09 08:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9836  13 56148 32346441 A  ERRORERROR'
2012-08-09 08:59:06 [DEBUG   ] Got command RPT from MCS: ref #9837
2012-08-09 08:59:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 08:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9837  77 56148 32346441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 08:59:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 08:59:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 09:00:01 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 09:00:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 09:00:05 [DEBUG   ] Finished updating board flags in 1.245 seconds
2012-08-09 09:00:21 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2012-08-09 09:00:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 09:01:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 09:01:06 [DEBUG   ] Finished updating board flags in 1.430 seconds
2012-08-09 09:01:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 09:01:41 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2012-08-09 09:02:02 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-09 09:02:06 [DEBUG   ] Finished updating board flags in 1.420 seconds
2012-08-09 09:02:22 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 09:02:42 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 09:03:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 09:03:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 09:03:06 [DEBUG   ] Finished updating board flags in 1.389 seconds
2012-08-09 09:03:22 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 09:03:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 09:04:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 09:04:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 09:04:06 [DEBUG   ] Finished updating board flags in 1.253 seconds
2012-08-09 09:04:06 [DEBUG   ] Got command RPT from MCS: ref #9853
2012-08-09 09:04:06 [DEBUG   ] summary = ERROR
2012-08-09 09:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9853  13 56148 32646449 A  ERRORERROR'
2012-08-09 09:04:06 [DEBUG   ] Got command RPT from MCS: ref #9854
2012-08-09 09:04:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 09:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9854  77 56148 32646449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 09:04:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 09:04:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 09:05:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 09:05:06 [DEBUG   ] Finished updating board flags in 1.246 seconds
2012-08-09 09:05:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 09:05:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 09:06:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 09:06:06 [DEBUG   ] Finished updating board flags in 1.253 seconds
2012-08-09 09:06:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 09:06:42 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 09:07:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 09:07:06 [DEBUG   ] Finished updating board flags in 1.421 seconds
2012-08-09 09:07:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 09:07:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 09:08:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 09:08:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 09:08:06 [DEBUG   ] Finished updating board flags in 1.432 seconds
2012-08-09 09:08:23 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-09 09:08:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 09:09:03 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2012-08-09 09:09:06 [DEBUG   ] Got command RPT from MCS: ref #9870
2012-08-09 09:09:06 [DEBUG   ] summary = ERROR
2012-08-09 09:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9870  13 56148 32946442 A  ERRORERROR'
2012-08-09 09:09:06 [DEBUG   ] Got command RPT from MCS: ref #9871
2012-08-09 09:09:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 09:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9871  77 56148 32946442 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 09:09:06 [DEBUG   ] Finished updating board flags in 1.436 seconds
2012-08-09 09:09:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 09:09:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 09:10:03 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 09:10:06 [DEBUG   ] Finished updating board flags in 1.433 seconds
2012-08-09 09:10:23 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 09:10:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 09:11:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 09:11:06 [DEBUG   ] Finished updating board flags in 1.451 seconds
2012-08-09 09:11:23 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 09:11:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 09:12:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 09:12:06 [DEBUG   ] Finished updating board flags in 1.467 seconds
2012-08-09 09:12:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 09:12:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 09:13:03 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 09:13:06 [DEBUG   ] Finished updating board flags in 1.687 seconds
2012-08-09 09:13:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 09:13:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 09:14:03 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 09:14:06 [DEBUG   ] Got command RPT from MCS: ref #9887
2012-08-09 09:14:06 [DEBUG   ] summary = ERROR
2012-08-09 09:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9887  13 56148 33246453 A  ERRORERROR'
2012-08-09 09:14:06 [DEBUG   ] Got command RPT from MCS: ref #9888
2012-08-09 09:14:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 09:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9888  77 56148 33246453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 09:14:06 [DEBUG   ] Finished updating board flags in 1.609 seconds
2012-08-09 09:14:23 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 09:14:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 09:15:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 09:15:06 [DEBUG   ] Finished updating board flags in 1.356 seconds
2012-08-09 09:15:23 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 09:15:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 09:16:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 09:16:06 [DEBUG   ] Finished updating board flags in 1.233 seconds
2012-08-09 09:16:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 09:16:43 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 09:17:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 09:17:06 [DEBUG   ] Finished updating board flags in 1.233 seconds
2012-08-09 09:17:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 09:17:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 09:18:03 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 09:18:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2012-08-09 09:18:06 [CRITICAL] MGT underflow detected on beam(s) 1
2012-08-09 09:18:06 [DEBUG   ] Finished updating board flags in 1.237 seconds
2012-08-09 09:18:24 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-09 09:18:44 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 09:19:04 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 09:19:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 09:19:06 [DEBUG   ] Got command RPT from MCS: ref #9904
2012-08-09 09:19:06 [DEBUG   ] summary = ERROR
2012-08-09 09:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9904  13 56148 33546445 A  ERRORERROR'
2012-08-09 09:19:06 [DEBUG   ] Got command RPT from MCS: ref #9905
2012-08-09 09:19:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 09:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9905  77 56148 33546445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 09:19:06 [DEBUG   ] Finished updating board flags in 1.234 seconds
2012-08-09 09:19:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 09:19:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 09:20:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 09:20:07 [DEBUG   ] Finished updating board flags in 1.446 seconds
2012-08-09 09:20:24 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2012-08-09 09:20:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 09:21:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 09:21:07 [DEBUG   ] Finished updating board flags in 1.425 seconds
2012-08-09 09:21:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 09:21:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 09:22:04 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 09:22:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 09:22:07 [DEBUG   ] Finished updating board flags in 1.371 seconds
2012-08-09 09:22:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 09:22:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 09:23:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 09:23:07 [DEBUG   ] Finished updating board flags in 1.257 seconds
2012-08-09 09:23:25 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2012-08-09 09:23:44 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2012-08-09 09:24:04 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2012-08-09 09:24:06 [DEBUG   ] Got command RPT from MCS: ref #9921
2012-08-09 09:24:06 [DEBUG   ] summary = ERROR
2012-08-09 09:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9921  13 56148 33846453 A  ERRORERROR'
2012-08-09 09:24:06 [DEBUG   ] Got command RPT from MCS: ref #9922
2012-08-09 09:24:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 09:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9922  77 56148 33846453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 09:24:07 [DEBUG   ] Finished updating board flags in 1.251 seconds
2012-08-09 09:24:25 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-09 09:24:45 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-09 09:25:05 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2012-08-09 09:25:07 [DEBUG   ] Finished updating board flags in 1.268 seconds
2012-08-09 09:25:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 09:25:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 09:26:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 09:26:07 [DEBUG   ] Finished updating board flags in 1.255 seconds
2012-08-09 09:26:25 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2012-08-09 09:26:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 09:27:05 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2012-08-09 09:27:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 09:27:07 [DEBUG   ] Finished updating board flags in 1.250 seconds
2012-08-09 09:27:26 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2012-08-09 09:27:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 09:28:06 [DEBUG   ] Finished updating ant stats in 1.249 seconds
2012-08-09 09:28:07 [DEBUG   ] Finished updating board flags in 1.266 seconds
2012-08-09 09:28:26 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2012-08-09 09:28:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 09:29:06 [DEBUG   ] Finished updating ant stats in 1.045 seconds
2012-08-09 09:29:06 [DEBUG   ] Got command RPT from MCS: ref #9938
2012-08-09 09:29:06 [DEBUG   ] summary = ERROR
2012-08-09 09:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9938  13 56148 34146445 A  ERRORERROR'
2012-08-09 09:29:06 [DEBUG   ] Got command RPT from MCS: ref #9939
2012-08-09 09:29:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 09:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9939  77 56148 34146445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 09:29:07 [DEBUG   ] Finished updating board flags in 1.321 seconds
2012-08-09 09:29:26 [DEBUG   ] Finished updating ant stats in 0.957 seconds
2012-08-09 09:29:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 09:30:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 09:30:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 09:30:07 [DEBUG   ] Finished updating board flags in 1.464 seconds
2012-08-09 09:30:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 09:30:46 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 09:31:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 09:31:07 [DEBUG   ] Finished updating board flags in 1.297 seconds
2012-08-09 09:31:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 09:31:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 09:32:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 09:32:07 [DEBUG   ] Finished updating board flags in 1.227 seconds
2012-08-09 09:32:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 09:32:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 09:33:06 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 09:33:07 [DEBUG   ] Finished updating board flags in 1.235 seconds
2012-08-09 09:33:27 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-09 09:33:47 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-09 09:34:06 [DEBUG   ] Got command RPT from MCS: ref #9955
2012-08-09 09:34:06 [DEBUG   ] summary = ERROR
2012-08-09 09:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9955  13 56148 34446445 A  ERRORERROR'
2012-08-09 09:34:06 [DEBUG   ] Got command RPT from MCS: ref #9956
2012-08-09 09:34:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 09:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9956  77 56148 34446445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 09:34:07 [DEBUG   ] Finished updating ant stats in 1.248 seconds
2012-08-09 09:34:07 [DEBUG   ] Finished updating board flags in 1.295 seconds
2012-08-09 09:34:27 [DEBUG   ] Finished updating ant stats in 1.165 seconds
2012-08-09 09:34:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 09:35:07 [DEBUG   ] Finished updating ant stats in 1.041 seconds
2012-08-09 09:35:08 [DEBUG   ] Finished updating board flags in 1.450 seconds
2012-08-09 09:35:27 [DEBUG   ] Finished updating ant stats in 0.960 seconds
2012-08-09 09:35:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 09:36:07 [DEBUG   ] Finished updating ant stats in 0.841 seconds
2012-08-09 09:36:08 [DEBUG   ] Finished updating board flags in 1.387 seconds
2012-08-09 09:36:27 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2012-08-09 09:36:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 09:37:08 [DEBUG   ] Finished updating board flags in 1.322 seconds
2012-08-09 09:37:08 [DEBUG   ] Finished updating ant stats in 1.434 seconds
2012-08-09 09:37:28 [DEBUG   ] Finished updating ant stats in 1.363 seconds
2012-08-09 09:37:48 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 09:38:08 [DEBUG   ] Finished updating ant stats in 1.239 seconds
2012-08-09 09:38:08 [DEBUG   ] Finished updating board flags in 1.336 seconds
2012-08-09 09:38:28 [DEBUG   ] Finished updating ant stats in 1.165 seconds
2012-08-09 09:38:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 09:39:06 [DEBUG   ] Got command RPT from MCS: ref #9972
2012-08-09 09:39:06 [DEBUG   ] summary = ERROR
2012-08-09 09:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9972  13 56148 34746449 A  ERRORERROR'
2012-08-09 09:39:06 [DEBUG   ] Got command RPT from MCS: ref #9973
2012-08-09 09:39:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 09:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9973  77 56148 34746449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 09:39:08 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2012-08-09 09:39:08 [DEBUG   ] Finished updating board flags in 1.330 seconds
2012-08-09 09:39:28 [DEBUG   ] Finished updating ant stats in 0.762 seconds
2012-08-09 09:39:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 09:40:08 [DEBUG   ] Finished updating ant stats in 0.640 seconds
2012-08-09 09:40:08 [DEBUG   ] Finished updating board flags in 1.334 seconds
2012-08-09 09:40:28 [DEBUG   ] Finished updating ant stats in 0.562 seconds
2012-08-09 09:40:49 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2012-08-09 09:41:08 [DEBUG   ] Finished updating board flags in 1.377 seconds
2012-08-09 09:41:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 09:41:29 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 09:41:49 [DEBUG   ] Finished updating ant stats in 1.186 seconds
2012-08-09 09:42:08 [DEBUG   ] Finished updating board flags in 1.295 seconds
2012-08-09 09:42:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 09:42:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 09:42:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 09:43:09 [DEBUG   ] Finished updating board flags in 1.467 seconds
2012-08-09 09:43:09 [DEBUG   ] Finished updating ant stats in 1.010 seconds
2012-08-09 09:43:29 [DEBUG   ] Finished updating ant stats in 0.989 seconds
2012-08-09 09:43:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 09:44:06 [DEBUG   ] Got command RPT from MCS: ref #9989
2012-08-09 09:44:06 [DEBUG   ] summary = ERROR
2012-08-09 09:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9989  13 56148 35046452 A  ERRORERROR'
2012-08-09 09:44:06 [DEBUG   ] Got command RPT from MCS: ref #9990
2012-08-09 09:44:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 09:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9990  77 56148 35046453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 09:44:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 09:44:09 [DEBUG   ] Finished updating board flags in 1.423 seconds
2012-08-09 09:44:09 [DEBUG   ] Finished updating ant stats in 0.635 seconds
2012-08-09 09:44:29 [DEBUG   ] Finished updating ant stats in 0.573 seconds
2012-08-09 09:44:50 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2012-08-09 09:45:09 [DEBUG   ] Finished updating board flags in 1.350 seconds
2012-08-09 09:45:10 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2012-08-09 09:45:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 09:45:50 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 09:46:09 [DEBUG   ] Finished updating board flags in 1.248 seconds
2012-08-09 09:46:10 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 09:46:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 09:46:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 09:47:09 [DEBUG   ] Finished updating board flags in 1.241 seconds
2012-08-09 09:47:10 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 09:47:30 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 09:47:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 09:48:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2012-08-09 09:48:09 [CRITICAL] MGT underflow detected on beam(s) 1
2012-08-09 09:48:09 [DEBUG   ] Finished updating board flags in 1.247 seconds
2012-08-09 09:48:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 09:48:30 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 09:48:50 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 09:49:06 [DEBUG   ] Got command RPT from MCS: ref #10006
2012-08-09 09:49:06 [DEBUG   ] summary = ERROR
2012-08-09 09:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10006  13 56148 35346469 A  ERRORERROR'
2012-08-09 09:49:06 [DEBUG   ] Got command RPT from MCS: ref #10007
2012-08-09 09:49:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 09:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10007  77 56148 35346469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 09:49:09 [DEBUG   ] Finished updating board flags in 1.270 seconds
2012-08-09 09:49:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 09:49:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 09:49:50 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 09:50:09 [DEBUG   ] Finished updating board flags in 1.272 seconds
2012-08-09 09:50:10 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 09:50:30 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-09 09:50:51 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2012-08-09 09:51:09 [DEBUG   ] Finished updating board flags in 1.278 seconds
2012-08-09 09:51:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 09:51:31 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-09 09:51:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 09:52:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 09:52:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 09:52:09 [DEBUG   ] Finished updating board flags in 1.275 seconds
2012-08-09 09:52:11 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2012-08-09 09:52:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 09:52:51 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 09:53:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 09:53:09 [DEBUG   ] Finished updating board flags in 1.448 seconds
2012-08-09 09:53:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 09:53:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 09:53:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 09:54:06 [DEBUG   ] Got command RPT from MCS: ref #10023
2012-08-09 09:54:06 [DEBUG   ] summary = ERROR
2012-08-09 09:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10023  13 56148 35646449 A  ERRORERROR'
2012-08-09 09:54:06 [DEBUG   ] Got command RPT from MCS: ref #10024
2012-08-09 09:54:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 09:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10024  77 56148 35646449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 09:54:09 [DEBUG   ] Finished updating board flags in 1.329 seconds
2012-08-09 09:54:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 09:54:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 09:54:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 09:55:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 09:55:09 [DEBUG   ] Finished updating board flags in 1.376 seconds
2012-08-09 09:55:11 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-09 09:55:32 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2012-08-09 09:55:52 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-09 09:56:10 [DEBUG   ] Finished updating board flags in 1.524 seconds
2012-08-09 09:56:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 09:56:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 09:56:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 09:57:10 [DEBUG   ] Finished updating board flags in 1.294 seconds
2012-08-09 09:57:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 09:57:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 09:57:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 09:58:10 [DEBUG   ] Finished updating board flags in 1.278 seconds
2012-08-09 09:58:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 09:58:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 09:58:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 09:59:06 [DEBUG   ] Got command RPT from MCS: ref #10040
2012-08-09 09:59:06 [DEBUG   ] summary = ERROR
2012-08-09 09:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10040  13 56148 35946453 A  ERRORERROR'
2012-08-09 09:59:06 [DEBUG   ] Got command RPT from MCS: ref #10041
2012-08-09 09:59:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 09:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10041  77 56148 35946453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 09:59:10 [DEBUG   ] Finished updating board flags in 1.280 seconds
2012-08-09 09:59:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 09:59:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 09:59:52 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 10:00:10 [DEBUG   ] Finished updating board flags in 1.282 seconds
2012-08-09 10:00:13 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-09 10:00:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 10:00:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 10:01:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 10:01:10 [DEBUG   ] Finished updating board flags in 1.280 seconds
2012-08-09 10:01:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 10:01:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 10:01:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 10:02:10 [DEBUG   ] Finished updating board flags in 1.283 seconds
2012-08-09 10:02:13 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 10:02:33 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2012-08-09 10:02:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 10:03:11 [DEBUG   ] Finished updating board flags in 1.830 seconds
2012-08-09 10:03:13 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2012-08-09 10:03:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 10:03:53 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-09 10:04:06 [DEBUG   ] Got command RPT from MCS: ref #10057
2012-08-09 10:04:06 [DEBUG   ] summary = ERROR
2012-08-09 10:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10057  13 56148 36246453 A  ERRORERROR'
2012-08-09 10:04:06 [DEBUG   ] Got command RPT from MCS: ref #10058
2012-08-09 10:04:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 10:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10058  77 56148 36246453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 10:04:10 [DEBUG   ] Finished updating board flags in 1.465 seconds
2012-08-09 10:04:14 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2012-08-09 10:04:34 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-09 10:04:54 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 10:05:11 [DEBUG   ] Finished updating board flags in 1.739 seconds
2012-08-09 10:05:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 10:05:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 10:05:54 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 10:06:10 [DEBUG   ] Finished updating board flags in 1.238 seconds
2012-08-09 10:06:14 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-09 10:06:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 10:06:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 10:07:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 10:07:10 [DEBUG   ] Finished updating board flags in 1.253 seconds
2012-08-09 10:07:14 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2012-08-09 10:07:34 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 10:07:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 10:08:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa34, chip 1
2012-08-09 10:08:10 [DEBUG   ] Finished updating board flags in 1.252 seconds
2012-08-09 10:08:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 10:08:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 10:08:54 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-09 10:09:06 [DEBUG   ] Got command RPT from MCS: ref #10074
2012-08-09 10:09:06 [DEBUG   ] summary = ERROR
2012-08-09 10:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10074  13 56148 36546453 A  ERRORERROR'
2012-08-09 10:09:06 [DEBUG   ] Got command RPT from MCS: ref #10075
2012-08-09 10:09:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 10:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10075  77 56148 36546453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 10:09:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-09 10:09:11 [DEBUG   ] Finished updating board flags in 1.442 seconds
2012-08-09 10:09:15 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 10:09:35 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-09 10:09:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 10:10:11 [DEBUG   ] Finished updating board flags in 1.430 seconds
2012-08-09 10:10:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 10:10:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 10:10:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 10:11:11 [DEBUG   ] Finished updating board flags in 1.383 seconds
2012-08-09 10:11:15 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2012-08-09 10:11:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 10:11:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 10:12:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 10:12:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 10:12:11 [DEBUG   ] Finished updating board flags in 1.252 seconds
2012-08-09 10:12:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 10:12:35 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 10:12:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 10:13:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 10:13:11 [DEBUG   ] Finished updating board flags in 1.255 seconds
2012-08-09 10:13:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 10:13:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 10:13:55 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2012-08-09 10:14:06 [DEBUG   ] Got command RPT from MCS: ref #10091
2012-08-09 10:14:06 [DEBUG   ] summary = ERROR
2012-08-09 10:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10091  13 56148 36846457 A  ERRORERROR'
2012-08-09 10:14:06 [DEBUG   ] Got command RPT from MCS: ref #10092
2012-08-09 10:14:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 10:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10092  77 56148 36846457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 10:14:11 [DEBUG   ] Finished updating board flags in 1.249 seconds
2012-08-09 10:14:16 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 10:14:36 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-09 10:14:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 10:15:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-09 10:15:11 [DEBUG   ] Finished updating board flags in 1.251 seconds
2012-08-09 10:15:16 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2012-08-09 10:15:36 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 10:15:56 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2012-08-09 10:16:11 [DEBUG   ] Finished updating board flags in 1.248 seconds
2012-08-09 10:16:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 10:16:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 10:16:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 10:17:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 10:17:11 [DEBUG   ] Finished updating board flags in 1.256 seconds
2012-08-09 10:17:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 10:17:36 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2012-08-09 10:17:57 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 10:18:11 [DEBUG   ] Finished updating board flags in 1.565 seconds
2012-08-09 10:18:17 [DEBUG   ] Finished updating ant stats in 1.193 seconds
2012-08-09 10:18:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 10:18:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 10:19:06 [DEBUG   ] Got command RPT from MCS: ref #10108
2012-08-09 10:19:06 [DEBUG   ] summary = ERROR
2012-08-09 10:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10108  13 56148 37146461 A  ERRORERROR'
2012-08-09 10:19:06 [DEBUG   ] Got command RPT from MCS: ref #10109
2012-08-09 10:19:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 10:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10109  77 56148 37146461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 10:19:11 [DEBUG   ] Finished updating board flags in 1.366 seconds
2012-08-09 10:19:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 10:19:37 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 10:19:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 10:20:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 10:20:11 [DEBUG   ] Finished updating board flags in 1.246 seconds
2012-08-09 10:20:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 10:20:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 10:20:57 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2012-08-09 10:21:11 [DEBUG   ] Finished updating board flags in 1.244 seconds
2012-08-09 10:21:17 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2012-08-09 10:21:38 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 10:21:58 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2012-08-09 10:22:11 [DEBUG   ] Finished updating board flags in 1.238 seconds
2012-08-09 10:22:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 10:22:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 10:22:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 10:23:12 [DEBUG   ] Finished updating board flags in 1.438 seconds
2012-08-09 10:23:18 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-09 10:23:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 10:23:58 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 10:24:06 [DEBUG   ] Got command RPT from MCS: ref #10125
2012-08-09 10:24:06 [DEBUG   ] summary = ERROR
2012-08-09 10:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10125  13 56148 37446465 A  ERRORERROR'
2012-08-09 10:24:06 [DEBUG   ] Got command RPT from MCS: ref #10126
2012-08-09 10:24:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 10:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10126  77 56148 37446465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 10:24:12 [DEBUG   ] Finished updating board flags in 1.434 seconds
2012-08-09 10:24:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 10:24:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 10:24:58 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 10:25:12 [DEBUG   ] Finished updating board flags in 1.398 seconds
2012-08-09 10:25:18 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 10:25:38 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 10:25:58 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 10:26:12 [DEBUG   ] Finished updating board flags in 1.251 seconds
2012-08-09 10:26:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 10:26:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 10:26:58 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 10:27:12 [DEBUG   ] Finished updating board flags in 1.335 seconds
2012-08-09 10:27:19 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2012-08-09 10:27:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 10:27:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 10:28:12 [DEBUG   ] Finished updating board flags in 1.334 seconds
2012-08-09 10:28:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 10:28:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 10:28:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 10:29:06 [DEBUG   ] Got command RPT from MCS: ref #10142
2012-08-09 10:29:06 [DEBUG   ] summary = ERROR
2012-08-09 10:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10142  13 56148 37746469 A  ERRORERROR'
2012-08-09 10:29:06 [DEBUG   ] Got command RPT from MCS: ref #10143
2012-08-09 10:29:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 10:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10143  77 56148 37746469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 10:29:12 [DEBUG   ] Finished updating board flags in 1.419 seconds
2012-08-09 10:29:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 10:29:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 10:29:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 10:30:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 10:30:12 [DEBUG   ] Finished updating board flags in 1.427 seconds
2012-08-09 10:30:19 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2012-08-09 10:30:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 10:30:59 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2012-08-09 10:31:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 10:31:12 [DEBUG   ] Finished updating board flags in 1.425 seconds
2012-08-09 10:31:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 10:31:39 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 10:31:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 10:32:12 [DEBUG   ] Finished updating board flags in 1.625 seconds
2012-08-09 10:32:19 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2012-08-09 10:32:40 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2012-08-09 10:33:00 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2012-08-09 10:33:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 10:33:12 [DEBUG   ] Finished updating board flags in 1.627 seconds
2012-08-09 10:33:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 10:33:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 10:34:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 10:34:06 [DEBUG   ] Got command RPT from MCS: ref #10159
2012-08-09 10:34:06 [DEBUG   ] summary = ERROR
2012-08-09 10:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10159  13 56148 38046469 A  ERRORERROR'
2012-08-09 10:34:06 [DEBUG   ] Got command RPT from MCS: ref #10160
2012-08-09 10:34:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 10:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10160  77 56148 38046469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 10:34:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 10:34:12 [DEBUG   ] Finished updating board flags in 1.384 seconds
2012-08-09 10:34:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 10:34:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 10:35:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 10:35:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 10:35:12 [DEBUG   ] Finished updating board flags in 1.237 seconds
2012-08-09 10:35:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 10:35:40 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 10:36:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 10:36:12 [DEBUG   ] Finished updating board flags in 1.241 seconds
2012-08-09 10:36:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 10:36:40 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 10:37:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 10:37:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2012-08-09 10:37:12 [DEBUG   ] Finished updating board flags in 1.237 seconds
2012-08-09 10:37:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 10:37:40 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 10:38:00 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 10:38:13 [DEBUG   ] Finished updating board flags in 1.472 seconds
2012-08-09 10:38:20 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2012-08-09 10:38:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 10:39:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 10:39:06 [DEBUG   ] Got command RPT from MCS: ref #10176
2012-08-09 10:39:06 [DEBUG   ] summary = ERROR
2012-08-09 10:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10176  13 56148 38346465 A  ERRORERROR'
2012-08-09 10:39:06 [DEBUG   ] Got command RPT from MCS: ref #10177
2012-08-09 10:39:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 10:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10177  77 56148 38346465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 10:39:13 [DEBUG   ] Finished updating board flags in 1.432 seconds
2012-08-09 10:39:20 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 10:39:41 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2012-08-09 10:40:01 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-09 10:40:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 10:40:13 [DEBUG   ] Finished updating board flags in 1.370 seconds
2012-08-09 10:40:20 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-09 10:40:41 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-09 10:41:01 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-09 10:41:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 10:41:13 [DEBUG   ] Finished updating board flags in 1.269 seconds
2012-08-09 10:41:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 10:41:41 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 10:42:01 [DEBUG   ] Finished updating ant stats in 1.007 seconds
2012-08-09 10:42:13 [DEBUG   ] Finished updating board flags in 1.274 seconds
2012-08-09 10:42:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 10:42:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 10:43:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 10:43:13 [DEBUG   ] Finished updating board flags in 1.290 seconds
2012-08-09 10:43:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 10:43:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 10:44:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 10:44:06 [DEBUG   ] Got command RPT from MCS: ref #10193
2012-08-09 10:44:06 [DEBUG   ] summary = ERROR
2012-08-09 10:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10193  13 56148 38646461 A  ERRORERROR'
2012-08-09 10:44:06 [DEBUG   ] Got command RPT from MCS: ref #10194
2012-08-09 10:44:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 10:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10194  77 56148 38646461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 10:44:13 [DEBUG   ] Finished updating board flags in 1.337 seconds
2012-08-09 10:44:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 10:44:41 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2012-08-09 10:45:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 10:45:13 [DEBUG   ] Finished updating board flags in 1.335 seconds
2012-08-09 10:45:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 10:45:41 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 10:46:01 [DEBUG   ] Finished updating ant stats in 0.607 seconds
2012-08-09 10:46:13 [DEBUG   ] Finished updating board flags in 1.445 seconds
2012-08-09 10:46:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 10:46:41 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2012-08-09 10:47:02 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-09 10:47:13 [DEBUG   ] Finished updating board flags in 1.286 seconds
2012-08-09 10:47:22 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-09 10:47:42 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 10:48:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 10:48:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 10:48:13 [DEBUG   ] Finished updating board flags in 1.243 seconds
2012-08-09 10:48:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 10:48:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 10:49:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 10:49:06 [DEBUG   ] Got command RPT from MCS: ref #10210
2012-08-09 10:49:06 [DEBUG   ] summary = ERROR
2012-08-09 10:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10210  13 56148 38946469 A  ERRORERROR'
2012-08-09 10:49:06 [DEBUG   ] Got command RPT from MCS: ref #10211
2012-08-09 10:49:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 10:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10211  77 56148 38946469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 10:49:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 10:49:13 [DEBUG   ] Finished updating board flags in 1.240 seconds
2012-08-09 10:49:22 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2012-08-09 10:49:42 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 10:50:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 10:50:13 [DEBUG   ] Finished updating board flags in 1.241 seconds
2012-08-09 10:50:22 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2012-08-09 10:50:42 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 10:51:03 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2012-08-09 10:51:13 [DEBUG   ] Finished updating board flags in 1.238 seconds
2012-08-09 10:51:22 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2012-08-09 10:51:43 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 10:52:03 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2012-08-09 10:52:14 [DEBUG   ] Finished updating board flags in 1.439 seconds
2012-08-09 10:52:23 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2012-08-09 10:52:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 10:53:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 10:53:14 [DEBUG   ] Finished updating board flags in 1.389 seconds
2012-08-09 10:53:23 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2012-08-09 10:53:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 10:54:03 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 10:54:06 [DEBUG   ] Got command RPT from MCS: ref #10227
2012-08-09 10:54:06 [DEBUG   ] summary = ERROR
2012-08-09 10:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10227  13 56148 39246469 A  ERRORERROR'
2012-08-09 10:54:06 [DEBUG   ] Got command RPT from MCS: ref #10228
2012-08-09 10:54:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 10:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10228  77 56148 39246469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 10:54:14 [DEBUG   ] Finished updating board flags in 1.239 seconds
2012-08-09 10:54:23 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-09 10:54:44 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-09 10:55:04 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2012-08-09 10:55:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 10:55:14 [DEBUG   ] Finished updating board flags in 1.240 seconds
2012-08-09 10:55:24 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2012-08-09 10:55:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2012-08-09 10:56:04 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 10:56:14 [DEBUG   ] Finished updating board flags in 1.236 seconds
2012-08-09 10:56:24 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 10:56:44 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 10:57:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 10:57:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 10:57:14 [DEBUG   ] Finished updating board flags in 1.236 seconds
2012-08-09 10:57:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 10:57:44 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 10:58:05 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-09 10:58:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 10:58:14 [DEBUG   ] Finished updating board flags in 1.236 seconds
2012-08-09 10:58:24 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2012-08-09 10:58:45 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 10:59:05 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2012-08-09 10:59:06 [DEBUG   ] Got command RPT from MCS: ref #10244
2012-08-09 10:59:06 [DEBUG   ] summary = ERROR
2012-08-09 10:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10244  13 56148 39546473 A  ERRORERROR'
2012-08-09 10:59:06 [DEBUG   ] Got command RPT from MCS: ref #10245
2012-08-09 10:59:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 10:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10245  77 56148 39546473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 10:59:14 [DEBUG   ] Finished updating board flags in 1.234 seconds
2012-08-09 10:59:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 10:59:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 11:00:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 11:00:14 [DEBUG   ] Finished updating board flags in 1.298 seconds
2012-08-09 11:00:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 11:00:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 11:01:05 [DEBUG   ] Finished updating ant stats in 0.852 seconds
2012-08-09 11:01:14 [DEBUG   ] Finished updating board flags in 1.300 seconds
2012-08-09 11:01:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 11:01:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 11:02:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 11:02:14 [DEBUG   ] Finished updating board flags in 1.497 seconds
2012-08-09 11:02:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 11:02:46 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-09 11:03:06 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 11:03:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 11:03:14 [DEBUG   ] Finished updating board flags in 1.416 seconds
2012-08-09 11:03:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 11:03:46 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2012-08-09 11:04:06 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-09 11:04:06 [DEBUG   ] Got command RPT from MCS: ref #10261
2012-08-09 11:04:06 [DEBUG   ] summary = ERROR
2012-08-09 11:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10261  13 56148 39846469 A  ERRORERROR'
2012-08-09 11:04:06 [DEBUG   ] Got command RPT from MCS: ref #10262
2012-08-09 11:04:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 11:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10262  77 56148 39846469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 11:04:14 [DEBUG   ] Finished updating board flags in 1.307 seconds
2012-08-09 11:04:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 11:04:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 11:05:06 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2012-08-09 11:05:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 11:05:14 [DEBUG   ] Finished updating board flags in 1.239 seconds
2012-08-09 11:05:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 11:05:46 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 11:06:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 11:06:14 [DEBUG   ] Finished updating board flags in 1.239 seconds
2012-08-09 11:06:26 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2012-08-09 11:06:46 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 11:07:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 11:07:14 [DEBUG   ] Finished updating board flags in 1.232 seconds
2012-08-09 11:07:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 11:07:46 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 11:08:06 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-09 11:08:14 [DEBUG   ] Finished updating board flags in 1.238 seconds
2012-08-09 11:08:27 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2012-08-09 11:08:47 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-09 11:09:06 [DEBUG   ] Got command RPT from MCS: ref #10278
2012-08-09 11:09:06 [DEBUG   ] summary = ERROR
2012-08-09 11:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10278  13 56148 40146473 A  ERRORERROR'
2012-08-09 11:09:06 [DEBUG   ] Got command RPT from MCS: ref #10279
2012-08-09 11:09:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 11:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10279  77 56148 40146473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 11:09:07 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 11:09:14 [DEBUG   ] Finished updating board flags in 1.229 seconds
2012-08-09 11:09:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 11:09:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 11:10:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 11:10:15 [DEBUG   ] Finished updating board flags in 1.438 seconds
2012-08-09 11:10:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 11:10:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 11:11:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 11:11:15 [DEBUG   ] Finished updating board flags in 1.430 seconds
2012-08-09 11:11:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 11:11:47 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 11:12:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 11:12:15 [DEBUG   ] Finished updating board flags in 1.364 seconds
2012-08-09 11:12:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 11:12:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 11:13:07 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 11:13:15 [DEBUG   ] Finished updating board flags in 1.271 seconds
2012-08-09 11:13:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 11:13:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 11:14:06 [DEBUG   ] Got command RPT from MCS: ref #10295
2012-08-09 11:14:06 [DEBUG   ] summary = ERROR
2012-08-09 11:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10295  13 56148 40446477 A  ERRORERROR'
2012-08-09 11:14:06 [DEBUG   ] Got command RPT from MCS: ref #10296
2012-08-09 11:14:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 11:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10296  77 56148 40446477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 11:14:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-09 11:14:15 [DEBUG   ] Finished updating board flags in 1.274 seconds
2012-08-09 11:14:28 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-09 11:14:48 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-09 11:15:08 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 11:15:15 [DEBUG   ] Finished updating board flags in 1.275 seconds
2012-08-09 11:15:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 11:15:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 11:16:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 11:16:15 [DEBUG   ] Finished updating board flags in 1.276 seconds
2012-08-09 11:16:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 11:16:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 11:17:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 11:17:15 [DEBUG   ] Finished updating board flags in 1.288 seconds
2012-08-09 11:17:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 11:17:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 11:18:08 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 11:18:15 [DEBUG   ] Finished updating board flags in 1.296 seconds
2012-08-09 11:18:28 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2012-08-09 11:18:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 11:19:06 [DEBUG   ] Got command RPT from MCS: ref #10312
2012-08-09 11:19:06 [DEBUG   ] summary = ERROR
2012-08-09 11:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10312  13 56148 40746473 A  ERRORERROR'
2012-08-09 11:19:06 [DEBUG   ] Got command RPT from MCS: ref #10313
2012-08-09 11:19:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 11:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10313  77 56148 40746473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 11:19:08 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-09 11:19:15 [DEBUG   ] Finished updating board flags in 1.431 seconds
2012-08-09 11:19:29 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2012-08-09 11:19:49 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2012-08-09 11:20:09 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-09 11:20:15 [DEBUG   ] Finished updating board flags in 1.328 seconds
2012-08-09 11:20:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 11:20:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 11:21:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 11:21:15 [DEBUG   ] Finished updating board flags in 1.239 seconds
2012-08-09 11:21:29 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 11:21:49 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2012-08-09 11:22:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 11:22:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 11:22:15 [DEBUG   ] Finished updating board flags in 1.236 seconds
2012-08-09 11:22:30 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2012-08-09 11:22:50 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 11:23:10 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 11:23:15 [DEBUG   ] Finished updating board flags in 1.240 seconds
2012-08-09 11:23:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 11:23:50 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-09 11:24:06 [DEBUG   ] Got command RPT from MCS: ref #10329
2012-08-09 11:24:06 [DEBUG   ] summary = ERROR
2012-08-09 11:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10329  13 56148 41046477 A  ERRORERROR'
2012-08-09 11:24:06 [DEBUG   ] Got command RPT from MCS: ref #10330
2012-08-09 11:24:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 11:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10330  77 56148 41046477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 11:24:10 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 11:24:15 [DEBUG   ] Finished updating board flags in 1.239 seconds
2012-08-09 11:24:30 [DEBUG   ] Finished updating ant stats in 0.964 seconds
2012-08-09 11:24:50 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2012-08-09 11:25:10 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 11:25:16 [DEBUG   ] Finished updating board flags in 1.432 seconds
2012-08-09 11:25:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 11:25:50 [DEBUG   ] Finished updating ant stats in 0.584 seconds
2012-08-09 11:26:11 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2012-08-09 11:26:16 [DEBUG   ] Finished updating board flags in 1.428 seconds
2012-08-09 11:26:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 11:26:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 11:27:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 11:27:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 11:27:16 [DEBUG   ] Finished updating board flags in 1.382 seconds
2012-08-09 11:27:31 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-09 11:27:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 11:28:11 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2012-08-09 11:28:16 [DEBUG   ] Finished updating board flags in 1.240 seconds
2012-08-09 11:28:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 11:28:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 11:29:06 [DEBUG   ] Got command RPT from MCS: ref #10346
2012-08-09 11:29:06 [DEBUG   ] summary = ERROR
2012-08-09 11:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10346  13 56148 41346473 A  ERRORERROR'
2012-08-09 11:29:06 [DEBUG   ] Got command RPT from MCS: ref #10347
2012-08-09 11:29:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 11:29:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10347  77 56148 41346473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 11:29:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 11:29:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 11:29:16 [DEBUG   ] Finished updating board flags in 1.258 seconds
2012-08-09 11:29:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 11:29:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 11:30:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 11:30:16 [DEBUG   ] Finished updating board flags in 1.260 seconds
2012-08-09 11:30:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 11:30:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 11:31:12 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-09 11:31:16 [DEBUG   ] Finished updating board flags in 1.267 seconds
2012-08-09 11:31:31 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-09 11:31:52 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2012-08-09 11:32:12 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-09 11:32:16 [DEBUG   ] Finished updating board flags in 1.262 seconds
2012-08-09 11:32:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 11:32:52 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2012-08-09 11:33:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2012-08-09 11:33:16 [DEBUG   ] Finished updating board flags in 1.262 seconds
2012-08-09 11:33:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 11:33:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 11:34:06 [DEBUG   ] Got command RPT from MCS: ref #10363
2012-08-09 11:34:06 [DEBUG   ] summary = ERROR
2012-08-09 11:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10363  13 56148 41646473 A  ERRORERROR'
2012-08-09 11:34:06 [DEBUG   ] Got command RPT from MCS: ref #10364
2012-08-09 11:34:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 11:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10364  77 56148 41646473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 11:34:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 11:34:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 11:34:16 [DEBUG   ] Finished updating board flags in 1.303 seconds
2012-08-09 11:34:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 11:34:52 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 11:35:12 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2012-08-09 11:35:16 [DEBUG   ] Finished updating board flags in 1.478 seconds
2012-08-09 11:35:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 11:35:52 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-09 11:36:13 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-09 11:36:16 [DEBUG   ] Finished updating board flags in 1.300 seconds
2012-08-09 11:36:32 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-09 11:36:52 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-09 11:37:13 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 11:37:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 11:37:16 [DEBUG   ] Finished updating board flags in 1.231 seconds
2012-08-09 11:37:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 11:37:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 11:38:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 11:38:16 [DEBUG   ] Finished updating board flags in 1.235 seconds
2012-08-09 11:38:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 11:38:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 11:39:06 [DEBUG   ] Got command RPT from MCS: ref #10380
2012-08-09 11:39:06 [DEBUG   ] summary = ERROR
2012-08-09 11:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10380  13 56148 41946497 A  ERRORERROR'
2012-08-09 11:39:06 [DEBUG   ] Got command RPT from MCS: ref #10381
2012-08-09 11:39:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 11:39:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10381  77 56148 41946497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 11:39:13 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 11:39:16 [DEBUG   ] Finished updating board flags in 1.232 seconds
2012-08-09 11:39:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 11:39:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 11:40:13 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2012-08-09 11:40:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 11:40:16 [DEBUG   ] Finished updating board flags in 1.238 seconds
2012-08-09 11:40:33 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2012-08-09 11:40:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 11:41:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 11:41:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 11:41:16 [DEBUG   ] Finished updating board flags in 1.232 seconds
2012-08-09 11:41:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 11:41:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 11:42:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 11:42:17 [DEBUG   ] Finished updating board flags in 1.436 seconds
2012-08-09 11:42:34 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-09 11:42:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 11:43:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 11:43:17 [DEBUG   ] Finished updating board flags in 1.422 seconds
2012-08-09 11:43:34 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 11:43:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 11:44:06 [DEBUG   ] Got command RPT from MCS: ref #10397
2012-08-09 11:44:06 [DEBUG   ] summary = ERROR
2012-08-09 11:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10397  13 56148 42246477 A  ERRORERROR'
2012-08-09 11:44:06 [DEBUG   ] Got command RPT from MCS: ref #10398
2012-08-09 11:44:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 11:44:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10398  77 56148 42246477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 11:44:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 11:44:17 [DEBUG   ] Finished updating board flags in 1.465 seconds
2012-08-09 11:44:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2012-08-09 11:44:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 11:45:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 11:45:17 [DEBUG   ] Finished updating board flags in 1.412 seconds
2012-08-09 11:45:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 11:45:55 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-09 11:46:15 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-09 11:46:17 [DEBUG   ] Finished updating board flags in 1.317 seconds
2012-08-09 11:46:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 11:46:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 11:47:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 11:47:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 11:47:17 [DEBUG   ] Finished updating board flags in 1.231 seconds
2012-08-09 11:47:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 11:47:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 11:48:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 11:48:17 [DEBUG   ] Finished updating board flags in 1.227 seconds
2012-08-09 11:48:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 11:48:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2012-08-09 11:49:06 [DEBUG   ] Got command RPT from MCS: ref #10414
2012-08-09 11:49:06 [DEBUG   ] summary = ERROR
2012-08-09 11:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10414  13 56148 42546476 A  ERRORERROR'
2012-08-09 11:49:06 [DEBUG   ] Got command RPT from MCS: ref #10415
2012-08-09 11:49:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 11:49:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10415  77 56148 42546477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 11:49:15 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2012-08-09 11:49:17 [DEBUG   ] Finished updating board flags in 1.292 seconds
2012-08-09 11:49:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 11:49:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 11:50:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 11:50:17 [DEBUG   ] Finished updating board flags in 1.290 seconds
2012-08-09 11:50:35 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2012-08-09 11:50:56 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2012-08-09 11:51:15 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-09 11:51:17 [DEBUG   ] Finished updating board flags in 1.290 seconds
2012-08-09 11:51:36 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 11:51:56 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2012-08-09 11:52:16 [DEBUG   ] Finished updating ant stats in 1.246 seconds
2012-08-09 11:52:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 11:52:17 [DEBUG   ] Finished updating board flags in 1.302 seconds
2012-08-09 11:52:36 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2012-08-09 11:52:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 11:53:16 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-09 11:53:17 [DEBUG   ] Finished updating board flags in 1.555 seconds
2012-08-09 11:53:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 11:53:56 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 11:54:06 [DEBUG   ] Got command RPT from MCS: ref #10431
2012-08-09 11:54:06 [DEBUG   ] summary = ERROR
2012-08-09 11:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10431  13 56148 42846481 A  ERRORERROR'
2012-08-09 11:54:06 [DEBUG   ] Got command RPT from MCS: ref #10432
2012-08-09 11:54:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 11:54:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10432  77 56148 42846481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 11:54:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 11:54:17 [DEBUG   ] Finished updating board flags in 1.263 seconds
2012-08-09 11:54:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 11:54:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 11:55:16 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 11:55:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 11:55:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2012-08-09 11:55:17 [CRITICAL] MGT underflow detected on beam(s) 1
2012-08-09 11:55:17 [DEBUG   ] Finished updating board flags in 1.238 seconds
2012-08-09 11:55:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 11:55:56 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2012-08-09 11:56:17 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2012-08-09 11:56:17 [DEBUG   ] Finished updating board flags in 1.237 seconds
2012-08-09 11:56:37 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-09 11:56:57 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 11:57:17 [DEBUG   ] Finished updating ant stats in 1.240 seconds
2012-08-09 11:57:18 [DEBUG   ] Finished updating board flags in 1.492 seconds
2012-08-09 11:57:37 [DEBUG   ] Finished updating ant stats in 1.160 seconds
2012-08-09 11:57:57 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2012-08-09 11:58:17 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2012-08-09 11:58:18 [DEBUG   ] Finished updating board flags in 1.420 seconds
2012-08-09 11:58:37 [DEBUG   ] Finished updating ant stats in 0.761 seconds
2012-08-09 11:58:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 11:59:06 [DEBUG   ] Got command RPT from MCS: ref #10448
2012-08-09 11:59:06 [DEBUG   ] summary = ERROR
2012-08-09 11:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10448  13 56148 43146489 A  ERRORERROR'
2012-08-09 11:59:06 [DEBUG   ] Got command RPT from MCS: ref #10449
2012-08-09 11:59:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 11:59:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10449  77 56148 43146489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 11:59:18 [DEBUG   ] Finished updating board flags in 1.409 seconds
2012-08-09 11:59:18 [DEBUG   ] Finished updating ant stats in 1.412 seconds
2012-08-09 11:59:38 [DEBUG   ] Finished updating ant stats in 1.390 seconds
2012-08-09 11:59:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2012-08-09 12:00:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2012-08-09 12:00:18 [DEBUG   ] Finished updating board flags in 1.431 seconds
2012-08-09 12:00:18 [DEBUG   ] Finished updating ant stats in 1.230 seconds
2012-08-09 12:00:38 [DEBUG   ] Finished updating ant stats in 1.165 seconds
2012-08-09 12:00:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 12:01:18 [DEBUG   ] Finished updating board flags in 1.377 seconds
2012-08-09 12:01:18 [DEBUG   ] Finished updating ant stats in 1.009 seconds
2012-08-09 12:01:38 [DEBUG   ] Finished updating ant stats in 0.991 seconds
2012-08-09 12:01:58 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 12:02:18 [DEBUG   ] Finished updating board flags in 1.349 seconds
2012-08-09 12:02:18 [DEBUG   ] Finished updating ant stats in 0.838 seconds
2012-08-09 12:02:38 [DEBUG   ] Finished updating ant stats in 0.764 seconds
2012-08-09 12:02:58 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2012-08-09 12:03:19 [DEBUG   ] Finished updating ant stats in 1.405 seconds
2012-08-09 12:03:19 [DEBUG   ] Finished updating board flags in 2.585 seconds
2012-08-09 12:03:39 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2012-08-09 12:03:59 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-09 12:04:06 [DEBUG   ] Got command RPT from MCS: ref #10465
2012-08-09 12:04:06 [DEBUG   ] summary = ERROR
2012-08-09 12:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10465  13 56148 43446485 A  ERRORERROR'
2012-08-09 12:04:06 [DEBUG   ] Got command RPT from MCS: ref #10466
2012-08-09 12:04:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 12:04:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10466  77 56148 43446485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 12:04:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 12:04:18 [DEBUG   ] Finished updating board flags in 1.317 seconds
2012-08-09 12:04:19 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 12:04:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 12:04:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 12:05:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2012-08-09 12:05:18 [CRITICAL] MGT underflow detected on beam(s) 1
2012-08-09 12:05:18 [DEBUG   ] Finished updating board flags in 1.456 seconds
2012-08-09 12:05:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2012-08-09 12:05:39 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-09 12:05:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 12:06:18 [DEBUG   ] Finished updating board flags in 1.380 seconds
2012-08-09 12:06:19 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 12:06:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2012-08-09 12:06:59 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 12:07:18 [DEBUG   ] Finished updating board flags in 1.339 seconds
2012-08-09 12:07:19 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2012-08-09 12:07:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 12:07:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2012-08-09 12:08:19 [DEBUG   ] Finished updating board flags in 1.444 seconds
2012-08-09 12:08:20 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2012-08-09 12:08:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2012-08-09 12:09:00 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 12:09:06 [DEBUG   ] Got command RPT from MCS: ref #10482
2012-08-09 12:09:06 [DEBUG   ] summary = ERROR
2012-08-09 12:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10482  13 56148 43746489 A  ERRORERROR'
2012-08-09 12:09:06 [DEBUG   ] Got command RPT from MCS: ref #10483
2012-08-09 12:09:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 12:09:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10483  77 56148 43746489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 12:09:19 [DEBUG   ] Finished updating board flags in 1.351 seconds
2012-08-09 12:09:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 12:09:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 12:10:00 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 12:10:19 [DEBUG   ] Finished updating board flags in 1.267 seconds
2012-08-09 12:10:20 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 12:10:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 12:11:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 12:11:19 [DEBUG   ] Finished updating board flags in 1.271 seconds
2012-08-09 12:11:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2012-08-09 12:11:40 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2012-08-09 12:12:01 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2012-08-09 12:12:19 [DEBUG   ] Finished updating board flags in 1.270 seconds
2012-08-09 12:12:21 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2012-08-09 12:12:41 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2012-08-09 12:13:01 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2012-08-09 12:13:19 [DEBUG   ] Finished updating board flags in 1.271 seconds
2012-08-09 12:13:21 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2012-08-09 12:13:41 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2012-08-09 12:14:01 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2012-08-09 12:14:06 [DEBUG   ] Got command RPT from MCS: ref #10499
2012-08-09 12:14:06 [DEBUG   ] summary = ERROR
2012-08-09 12:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10499  13 56148 44046481 A  ERRORERROR'
2012-08-09 12:14:06 [DEBUG   ] Got command RPT from MCS: ref #10500
2012-08-09 12:14:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 12:14:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10500  77 56148 44046481 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 12:14:19 [DEBUG   ] Finished updating board flags in 1.273 seconds
2012-08-09 12:14:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 12:14:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 12:15:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2012-08-09 12:15:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2012-08-09 12:15:19 [DEBUG   ] Finished updating board flags in 1.276 seconds
2012-08-09 12:15:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 12:15:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 12:16:01 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 12:16:19 [DEBUG   ] Finished updating board flags in 1.438 seconds
2012-08-09 12:16:22 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2012-08-09 12:16:42 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 12:17:02 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2012-08-09 12:17:19 [DEBUG   ] Finished updating board flags in 1.337 seconds
2012-08-09 12:17:22 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 12:17:42 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2012-08-09 12:18:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2012-08-09 12:18:19 [DEBUG   ] Finished updating board flags in 1.246 seconds
2012-08-09 12:18:22 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2012-08-09 12:18:42 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2012-08-09 12:19:02 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2012-08-09 12:19:06 [DEBUG   ] Got command RPT from MCS: ref #10516
2012-08-09 12:19:06 [DEBUG   ] summary = ERROR
2012-08-09 12:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10516  13 56148 44346492 A  ERRORERROR'
2012-08-09 12:19:06 [DEBUG   ] Got command RPT from MCS: ref #10517
2012-08-09 12:19:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 12:19:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10517  77 56148 44346493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 12:19:19 [DEBUG   ] Finished updating board flags in 1.244 seconds
2012-08-09 12:19:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2012-08-09 12:19:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2012-08-09 12:20:02 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 12:20:19 [DEBUG   ] Finished updating board flags in 1.251 seconds
2012-08-09 12:20:22 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 12:20:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 12:21:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2012-08-09 12:21:20 [DEBUG   ] Finished updating board flags in 1.579 seconds
2012-08-09 12:21:22 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2012-08-09 12:21:43 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2012-08-09 12:22:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2012-08-09 12:22:20 [DEBUG   ] Finished updating board flags in 1.299 seconds
2012-08-09 12:22:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2012-08-09 12:22:43 [DEBUG   ] Finished updating ant stats in 0.981 seconds
2012-08-09 12:23:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2012-08-09 12:23:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2012-08-09 12:23:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2012-08-09 12:23:20 [DEBUG   ] Finished updating board flags in 1.259 seconds
2012-08-09 12:23:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2012-08-09 12:23:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2012-08-09 12:24:03 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2012-08-09 12:24:06 [DEBUG   ] Got command RPT from MCS: ref #10533
2012-08-09 12:24:06 [DEBUG   ] summary = ERROR
2012-08-09 12:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10533  13 56148 44646489 A  ERRORERROR'
2012-08-09 12:24:06 [DEBUG   ] Got command RPT from MCS: ref #10534
2012-08-09 12:24:06 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2012-08-09 12:24:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10534  77 56148 44646489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2012-08-09 12:24:20 [DEBUG   ] Finished updating board flags in 1.259 seconds
2012-08-09 12:24:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2012-08-09 12:24:43 [DEBUG   ] Finished updating ant stats in 0.599 seconds
