2013-08-12 12:25:05 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2013-08-12 12:25:25 [DEBUG   ] Finished updating ant stats in 0.467 seconds
2013-08-12 12:25:45 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-08-12 12:25:46 [DEBUG   ] Finished updating board flags in 1.530 seconds
2013-08-12 12:26:05 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-08-12 12:26:25 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-08-12 12:26:45 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2013-08-12 12:26:46 [DEBUG   ] Finished updating board flags in 1.547 seconds
2013-08-12 12:27:06 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-08-12 12:27:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 12:27:46 [DEBUG   ] Finished updating ant stats in 1.051 seconds
2013-08-12 12:27:47 [DEBUG   ] Finished updating board flags in 2.186 seconds
2013-08-12 12:28:06 [DEBUG   ] Finished updating ant stats in 0.953 seconds
2013-08-12 12:28:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 12:28:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2013-08-12 12:28:46 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2013-08-12 12:28:47 [DEBUG   ] Finished updating board flags in 2.025 seconds
2013-08-12 12:29:06 [DEBUG   ] Finished updating ant stats in 0.755 seconds
2013-08-12 12:29:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 12:29:46 [DEBUG   ] Finished updating ant stats in 0.652 seconds
2013-08-12 12:29:47 [DEBUG   ] Finished updating board flags in 1.860 seconds
2013-08-12 12:29:59 [DEBUG   ] Got command RPT from MCS: ref #14868
2013-08-12 12:29:59 [DEBUG   ] summary = NORMAL
2013-08-12 12:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14868  14 56516 44999379 A NORMALNORMAL'
2013-08-12 12:29:59 [DEBUG   ] Got command RPT from MCS: ref #14869
2013-08-12 12:29:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 12:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14869  48 56516 44999379 A NORMALSystem calibrated and operating normally'
2013-08-12 12:30:06 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2013-08-12 12:30:27 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-08-12 12:30:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2013-08-12 12:30:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2013-08-12 12:30:47 [DEBUG   ] Finished updating ant stats in 1.249 seconds
2013-08-12 12:30:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 4
2013-08-12 12:30:47 [DEBUG   ] Finished updating board flags in 1.885 seconds
2013-08-12 12:31:07 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2013-08-12 12:31:27 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-08-12 12:31:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-08-12 12:31:47 [DEBUG   ] Finished updating ant stats in 0.843 seconds
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-08-12 12:31:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-08-12 12:31:47 [DEBUG   ] Finished updating board flags in 1.802 seconds
2013-08-12 12:32:07 [DEBUG   ] Finished updating ant stats in 0.761 seconds
2013-08-12 12:32:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-12 12:32:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-12 12:32:47 [DEBUG   ] Finished updating ant stats in 0.643 seconds
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-12 12:32:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-12 12:32:47 [DEBUG   ] Finished updating board flags in 1.813 seconds
2013-08-12 12:33:07 [DEBUG   ] Finished updating ant stats in 0.562 seconds
2013-08-12 12:33:27 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-08-12 12:33:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2013-08-12 12:33:47 [DEBUG   ] Finished updating board flags in 1.778 seconds
2013-08-12 12:33:48 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-08-12 12:34:08 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-08-12 12:34:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 12:34:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2013-08-12 12:34:47 [DEBUG   ] Finished updating board flags in 1.596 seconds
2013-08-12 12:34:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 12:34:59 [DEBUG   ] Got command RPT from MCS: ref #14885
2013-08-12 12:34:59 [DEBUG   ] summary = NORMAL
2013-08-12 12:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14885  14 56516 45299375 A NORMALNORMAL'
2013-08-12 12:34:59 [DEBUG   ] Got command RPT from MCS: ref #14886
2013-08-12 12:34:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 12:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14886  48 56516 45299376 A NORMALSystem calibrated and operating normally'
2013-08-12 12:35:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 12:35:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-12 12:35:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2013-08-12 12:35:47 [DEBUG   ] Finished updating board flags in 1.401 seconds
2013-08-12 12:35:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 12:36:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 12:36:28 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 12:36:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2013-08-12 12:36:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2013-08-12 12:36:47 [DEBUG   ] Finished updating board flags in 1.382 seconds
2013-08-12 12:36:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 12:37:08 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-12 12:37:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 12:37:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2013-08-12 12:37:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2013-08-12 12:37:48 [DEBUG   ] Finished updating ant stats in 0.643 seconds
2013-08-12 12:37:48 [DEBUG   ] Finished updating board flags in 2.230 seconds
2013-08-12 12:38:08 [DEBUG   ] Finished updating ant stats in 0.561 seconds
2013-08-12 12:38:28 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-08-12 12:38:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2013-08-12 12:38:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2013-08-12 12:38:48 [DEBUG   ] Finished updating board flags in 2.188 seconds
2013-08-12 12:38:49 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-08-12 12:39:09 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-08-12 12:39:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 12:39:48 [DEBUG   ] Finished updating board flags in 2.012 seconds
2013-08-12 12:39:49 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 12:39:59 [DEBUG   ] Got command RPT from MCS: ref #14902
2013-08-12 12:39:59 [DEBUG   ] summary = NORMAL
2013-08-12 12:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14902  14 56516 45599379 A NORMALNORMAL'
2013-08-12 12:39:59 [DEBUG   ] Got command RPT from MCS: ref #14903
2013-08-12 12:39:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 12:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14903  48 56516 45599380 A NORMALSystem calibrated and operating normally'
2013-08-12 12:40:09 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-12 12:40:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 12:40:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2013-08-12 12:40:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2013-08-12 12:40:48 [DEBUG   ] Finished updating board flags in 1.982 seconds
2013-08-12 12:40:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 12:41:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-12 12:41:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 12:41:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 3
2013-08-12 12:41:49 [DEBUG   ] Finished updating ant stats in 0.807 seconds
2013-08-12 12:41:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2013-08-12 12:41:49 [DEBUG   ] Finished updating board flags in 2.520 seconds
2013-08-12 12:42:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 12:42:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-12 12:42:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2013-08-12 12:42:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2013-08-12 12:42:48 [DEBUG   ] Finished updating board flags in 1.668 seconds
2013-08-12 12:42:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 12:43:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 12:43:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 12:43:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 3
2013-08-12 12:43:48 [DEBUG   ] Finished updating board flags in 1.592 seconds
2013-08-12 12:43:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-12 12:44:10 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-08-12 12:44:29 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-12 12:44:48 [DEBUG   ] Finished updating board flags in 1.385 seconds
2013-08-12 12:44:49 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-08-12 12:44:59 [DEBUG   ] Got command RPT from MCS: ref #14919
2013-08-12 12:44:59 [DEBUG   ] summary = NORMAL
2013-08-12 12:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14919  14 56516 45899379 A NORMALNORMAL'
2013-08-12 12:44:59 [DEBUG   ] Got command RPT from MCS: ref #14920
2013-08-12 12:44:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 12:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14920  48 56516 45899379 A NORMALSystem calibrated and operating normally'
2013-08-12 12:45:10 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-08-12 12:45:30 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-12 12:45:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2013-08-12 12:45:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 3
2013-08-12 12:45:48 [DEBUG   ] Finished updating board flags in 1.372 seconds
2013-08-12 12:45:50 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 12:46:10 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 12:46:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 12:46:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 3
2013-08-12 12:46:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2013-08-12 12:46:49 [DEBUG   ] Finished updating board flags in 2.099 seconds
2013-08-12 12:46:50 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-12 12:47:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 12:47:30 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-12 12:47:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2013-08-12 12:47:49 [DEBUG   ] Finished updating board flags in 1.942 seconds
2013-08-12 12:47:50 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-08-12 12:48:11 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-08-12 12:48:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 12:48:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 2
2013-08-12 12:48:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2013-08-12 12:48:49 [DEBUG   ] Finished updating board flags in 1.820 seconds
2013-08-12 12:48:51 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 12:49:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 12:49:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 12:49:49 [DEBUG   ] Finished updating board flags in 1.783 seconds
2013-08-12 12:49:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 12:49:59 [DEBUG   ] Got command RPT from MCS: ref #14936
2013-08-12 12:49:59 [DEBUG   ] summary = NORMAL
2013-08-12 12:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14936  14 56516 46199387 A NORMALNORMAL'
2013-08-12 12:49:59 [DEBUG   ] Got command RPT from MCS: ref #14937
2013-08-12 12:49:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 12:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14937  48 56516 46199387 A NORMALSystem calibrated and operating normally'
2013-08-12 12:50:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 12:50:31 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-12 12:50:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2013-08-12 12:50:49 [DEBUG   ] Finished updating board flags in 1.631 seconds
2013-08-12 12:50:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 12:51:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-12 12:51:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 12:51:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2013-08-12 12:51:49 [DEBUG   ] Finished updating board flags in 1.575 seconds
2013-08-12 12:51:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 12:52:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 12:52:31 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-12 12:52:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2013-08-12 12:52:49 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2013-08-12 12:52:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2013-08-12 12:52:49 [DEBUG   ] Finished updating board flags in 1.418 seconds
2013-08-12 12:52:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-12 12:53:12 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-08-12 12:53:32 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-12 12:53:49 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2013-08-12 12:53:49 [DEBUG   ] Finished updating board flags in 1.379 seconds
2013-08-12 12:53:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 12:54:12 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-12 12:54:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 12:54:48 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2013-08-12 12:54:49 [DEBUG   ] Finished updating board flags in 1.359 seconds
2013-08-12 12:54:50 [DEBUG   ] Got command SHT from MCS: ref #14953
2013-08-12 12:54:50 [DEBUG   ] Stopping antenna statistics
2013-08-12 12:54:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_SHT    14953   8 56516 46490783 ASHUTDWN'
2013-08-12 12:54:52 [DEBUG   ] Stopping beam statistics
2013-08-12 12:54:52 [DEBUG   ] Stopping monitoring flags
2013-08-12 12:54:52 [DEBUG   ] Stopping BAM updater
2013-08-12 12:54:52 [DEBUG   ] Stopping DRX time setter
2013-08-12 12:54:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:54:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:54:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:54:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:54:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:54:54 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:54:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:54:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:54:55 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:54:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:54:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:54:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:54:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:54:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:54:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:54:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:54:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:54:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:54:59 [DEBUG   ] Got command RPT from MCS: ref #14955
2013-08-12 12:54:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 12:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14955  15 56516 46499383 ASHUTDWNSHUTDWN'
2013-08-12 12:54:59 [DEBUG   ] Got command RPT from MCS: ref #14956
2013-08-12 12:54:59 [DEBUG   ] info = System is shutting down
2013-08-12 12:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14956  31 56516 46499383 ASHUTDWNSystem is shutting down'
2013-08-12 12:54:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:54:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:55:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:55:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:55:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:55:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:55:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:55:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:55:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:55:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh with timeout 10 s
2013-08-12 12:55:03 [DEBUG   ] run_process: at 2013-08-12 12:55:03 running ['/usr/local/bin/lwa16', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:03 [DEBUG   ] run_process: at 2013-08-12 12:55:03 running ['/usr/local/bin/lwa27', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:03 [DEBUG   ] run_process: at 2013-08-12 12:55:03 running ['/usr/local/bin/lwa24', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:03 [DEBUG   ] run_process: at 2013-08-12 12:55:03 running ['/usr/local/bin/lwa23', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:03 [DEBUG   ] run_process: at 2013-08-12 12:55:03 running ['/usr/local/bin/lwa18', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:03 [DEBUG   ] run_process: at 2013-08-12 12:55:03 running ['/usr/local/bin/lwa10', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:03 [DEBUG   ] run_process: at 2013-08-12 12:55:03 running ['/usr/local/bin/lwa32', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:04 [DEBUG   ] run_process: at 2013-08-12 12:55:04 running ['/usr/local/bin/lwa11', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:04 [DEBUG   ] run_process: at 2013-08-12 12:55:04 running ['/usr/local/bin/lwa30', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:04 [DEBUG   ] run_process: at 2013-08-12 12:55:04 running ['/usr/local/bin/lwa12', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:04 [DEBUG   ] run_process: at 2013-08-12 12:55:04 running ['/usr/local/bin/lwa8', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:04 [DEBUG   ] run_process: at 2013-08-12 12:55:04 running ['/usr/local/bin/lwa13', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:04 [DEBUG   ] run_process: at 2013-08-12 12:55:04 running ['/usr/local/bin/lwa26', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:04 [DEBUG   ] run_process: at 2013-08-12 12:55:04 running ['/usr/local/bin/lwa14', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:04 [DEBUG   ] run_process: at 2013-08-12 12:55:04 running ['/usr/local/bin/lwa34', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:05 [DEBUG   ] run_process: at 2013-08-12 12:55:05 running ['/usr/local/bin/lwa22', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:05 [DEBUG   ] run_process: at 2013-08-12 12:55:05 running ['/usr/local/bin/lwa20', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:05 [DEBUG   ] run_process: at 2013-08-12 12:55:05 running ['/usr/local/bin/lwa1', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:05 [DEBUG   ] run_process: at 2013-08-12 12:55:05 running ['/usr/local/bin/lwa5', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:05 [DEBUG   ] run_process: at 2013-08-12 12:55:05 running ['/usr/local/bin/lwa25', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:05 [DEBUG   ] run_process: at 2013-08-12 12:55:05 running ['/usr/local/bin/lwa35', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:05 [DEBUG   ] run_process: at 2013-08-12 12:55:05 running ['/usr/local/bin/lwa19', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:05 [DEBUG   ] run_process: at 2013-08-12 12:55:05 running ['/usr/local/bin/lwa21', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:05 [DEBUG   ] run_process: at 2013-08-12 12:55:05 running ['/usr/local/bin/lwa6', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:06 [DEBUG   ] run_process: at 2013-08-12 12:55:06 running ['/usr/local/bin/lwa7', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:06 [DEBUG   ] run_process: at 2013-08-12 12:55:06 running ['/usr/local/bin/lwa33', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:06 [DEBUG   ] run_process: at 2013-08-12 12:55:06 running ['/usr/local/bin/lwa15', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:06 [DEBUG   ] run_process: at 2013-08-12 12:55:06 running ['/usr/local/bin/lwa28', '/lwa/software/Shutdown.sh']
2013-08-12 12:55:06 [INFO    ] Finished the SHT process in 15.737 s
2013-08-12 12:59:59 [DEBUG   ] Got command RPT from MCS: ref #14972
2013-08-12 12:59:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 12:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14972  15 56516 46799387 ASHUTDWNSHUTDWN'
2013-08-12 12:59:59 [DEBUG   ] Got command RPT from MCS: ref #14973
2013-08-12 12:59:59 [DEBUG   ] info = System has been shut down
2013-08-12 12:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14973  33 56516 46799387 ASHUTDWNSystem has been shut down'
2013-08-12 13:04:59 [DEBUG   ] Got command RPT from MCS: ref #14989
2013-08-12 13:04:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 13:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14989  15 56516 47099387 ASHUTDWNSHUTDWN'
2013-08-12 13:04:59 [DEBUG   ] Got command RPT from MCS: ref #14990
2013-08-12 13:04:59 [DEBUG   ] info = System has been shut down
2013-08-12 13:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    14990  33 56516 47099387 ASHUTDWNSystem has been shut down'
2013-08-12 13:09:59 [DEBUG   ] Got command RPT from MCS: ref #15006
2013-08-12 13:09:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 13:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15006  15 56516 47399387 ASHUTDWNSHUTDWN'
2013-08-12 13:09:59 [DEBUG   ] Got command RPT from MCS: ref #15007
2013-08-12 13:09:59 [DEBUG   ] info = System has been shut down
2013-08-12 13:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15007  33 56516 47399387 ASHUTDWNSystem has been shut down'
2013-08-12 13:14:59 [DEBUG   ] Got command RPT from MCS: ref #15023
2013-08-12 13:14:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 13:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15023  15 56516 47699387 ASHUTDWNSHUTDWN'
2013-08-12 13:14:59 [DEBUG   ] Got command RPT from MCS: ref #15024
2013-08-12 13:14:59 [DEBUG   ] info = System has been shut down
2013-08-12 13:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15024  33 56516 47699387 ASHUTDWNSystem has been shut down'
2013-08-12 13:19:59 [DEBUG   ] Got command RPT from MCS: ref #15040
2013-08-12 13:19:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 13:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15040  15 56516 47999391 ASHUTDWNSHUTDWN'
2013-08-12 13:19:59 [DEBUG   ] Got command RPT from MCS: ref #15041
2013-08-12 13:19:59 [DEBUG   ] info = System has been shut down
2013-08-12 13:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15041  33 56516 47999391 ASHUTDWNSystem has been shut down'
2013-08-12 13:24:59 [DEBUG   ] Got command RPT from MCS: ref #15057
2013-08-12 13:24:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 13:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15057  15 56516 48299391 ASHUTDWNSHUTDWN'
2013-08-12 13:24:59 [DEBUG   ] Got command RPT from MCS: ref #15058
2013-08-12 13:24:59 [DEBUG   ] info = System has been shut down
2013-08-12 13:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15058  33 56516 48299391 ASHUTDWNSystem has been shut down'
2013-08-12 13:29:59 [DEBUG   ] Got command RPT from MCS: ref #15074
2013-08-12 13:29:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 13:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15074  15 56516 48599387 ASHUTDWNSHUTDWN'
2013-08-12 13:29:59 [DEBUG   ] Got command RPT from MCS: ref #15075
2013-08-12 13:29:59 [DEBUG   ] info = System has been shut down
2013-08-12 13:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15075  33 56516 48599387 ASHUTDWNSystem has been shut down'
2013-08-12 13:34:59 [DEBUG   ] Got command RPT from MCS: ref #15091
2013-08-12 13:34:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 13:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15091  15 56516 48899391 ASHUTDWNSHUTDWN'
2013-08-12 13:34:59 [DEBUG   ] Got command RPT from MCS: ref #15092
2013-08-12 13:34:59 [DEBUG   ] info = System has been shut down
2013-08-12 13:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15092  33 56516 48899391 ASHUTDWNSystem has been shut down'
2013-08-12 13:39:59 [DEBUG   ] Got command RPT from MCS: ref #15108
2013-08-12 13:39:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 13:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15108  15 56516 49199391 ASHUTDWNSHUTDWN'
2013-08-12 13:39:59 [DEBUG   ] Got command RPT from MCS: ref #15109
2013-08-12 13:39:59 [DEBUG   ] info = System has been shut down
2013-08-12 13:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15109  33 56516 49199391 ASHUTDWNSystem has been shut down'
2013-08-12 13:44:59 [DEBUG   ] Got command RPT from MCS: ref #15125
2013-08-12 13:44:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 13:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15125  15 56516 49499399 ASHUTDWNSHUTDWN'
2013-08-12 13:44:59 [DEBUG   ] Got command RPT from MCS: ref #15126
2013-08-12 13:44:59 [DEBUG   ] info = System has been shut down
2013-08-12 13:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15126  33 56516 49499399 ASHUTDWNSystem has been shut down'
2013-08-12 13:49:59 [DEBUG   ] Got command RPT from MCS: ref #15142
2013-08-12 13:49:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 13:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15142  15 56516 49799395 ASHUTDWNSHUTDWN'
2013-08-12 13:49:59 [DEBUG   ] Got command RPT from MCS: ref #15143
2013-08-12 13:49:59 [DEBUG   ] info = System has been shut down
2013-08-12 13:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15143  33 56516 49799395 ASHUTDWNSystem has been shut down'
2013-08-12 13:54:59 [DEBUG   ] Got command RPT from MCS: ref #15159
2013-08-12 13:54:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 13:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15159  15 56516 50099399 ASHUTDWNSHUTDWN'
2013-08-12 13:54:59 [DEBUG   ] Got command RPT from MCS: ref #15160
2013-08-12 13:54:59 [DEBUG   ] info = System has been shut down
2013-08-12 13:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15160  33 56516 50099399 ASHUTDWNSystem has been shut down'
2013-08-12 13:59:59 [DEBUG   ] Got command RPT from MCS: ref #15176
2013-08-12 13:59:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 13:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15176  15 56516 50399403 ASHUTDWNSHUTDWN'
2013-08-12 13:59:59 [DEBUG   ] Got command RPT from MCS: ref #15177
2013-08-12 13:59:59 [DEBUG   ] info = System has been shut down
2013-08-12 13:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15177  33 56516 50399403 ASHUTDWNSystem has been shut down'
2013-08-12 14:04:59 [DEBUG   ] Got command RPT from MCS: ref #15193
2013-08-12 14:04:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 14:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15193  15 56516 50699395 ASHUTDWNSHUTDWN'
2013-08-12 14:04:59 [DEBUG   ] Got command RPT from MCS: ref #15194
2013-08-12 14:04:59 [DEBUG   ] info = System has been shut down
2013-08-12 14:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15194  33 56516 50699395 ASHUTDWNSystem has been shut down'
2013-08-12 14:09:59 [DEBUG   ] Got command RPT from MCS: ref #15210
2013-08-12 14:09:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 14:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15210  15 56516 50999403 ASHUTDWNSHUTDWN'
2013-08-12 14:09:59 [DEBUG   ] Got command RPT from MCS: ref #15211
2013-08-12 14:09:59 [DEBUG   ] info = System has been shut down
2013-08-12 14:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15211  33 56516 50999403 ASHUTDWNSystem has been shut down'
2013-08-12 14:14:59 [DEBUG   ] Got command RPT from MCS: ref #15227
2013-08-12 14:14:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 14:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15227  15 56516 51299407 ASHUTDWNSHUTDWN'
2013-08-12 14:14:59 [DEBUG   ] Got command RPT from MCS: ref #15228
2013-08-12 14:14:59 [DEBUG   ] info = System has been shut down
2013-08-12 14:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15228  33 56516 51299407 ASHUTDWNSystem has been shut down'
2013-08-12 14:19:59 [DEBUG   ] Got command RPT from MCS: ref #15244
2013-08-12 14:19:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 14:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15244  15 56516 51599407 ASHUTDWNSHUTDWN'
2013-08-12 14:19:59 [DEBUG   ] Got command RPT from MCS: ref #15245
2013-08-12 14:19:59 [DEBUG   ] info = System has been shut down
2013-08-12 14:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15245  33 56516 51599407 ASHUTDWNSystem has been shut down'
2013-08-12 14:24:59 [DEBUG   ] Got command RPT from MCS: ref #15261
2013-08-12 14:24:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 14:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15261  15 56516 51899403 ASHUTDWNSHUTDWN'
2013-08-12 14:24:59 [DEBUG   ] Got command RPT from MCS: ref #15262
2013-08-12 14:24:59 [DEBUG   ] info = System has been shut down
2013-08-12 14:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15262  33 56516 51899403 ASHUTDWNSystem has been shut down'
2013-08-12 14:29:59 [DEBUG   ] Got command RPT from MCS: ref #15278
2013-08-12 14:29:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 14:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15278  15 56516 52199407 ASHUTDWNSHUTDWN'
2013-08-12 14:29:59 [DEBUG   ] Got command RPT from MCS: ref #15279
2013-08-12 14:29:59 [DEBUG   ] info = System has been shut down
2013-08-12 14:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15279  33 56516 52199407 ASHUTDWNSystem has been shut down'
2013-08-12 14:34:59 [DEBUG   ] Got command RPT from MCS: ref #15295
2013-08-12 14:34:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 14:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15295  15 56516 52499415 ASHUTDWNSHUTDWN'
2013-08-12 14:34:59 [DEBUG   ] Got command RPT from MCS: ref #15296
2013-08-12 14:34:59 [DEBUG   ] info = System has been shut down
2013-08-12 14:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15296  33 56516 52499415 ASHUTDWNSystem has been shut down'
2013-08-12 14:39:59 [DEBUG   ] Got command RPT from MCS: ref #15312
2013-08-12 14:39:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 14:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15312  15 56516 52799407 ASHUTDWNSHUTDWN'
2013-08-12 14:39:59 [DEBUG   ] Got command RPT from MCS: ref #15313
2013-08-12 14:39:59 [DEBUG   ] info = System has been shut down
2013-08-12 14:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15313  33 56516 52799407 ASHUTDWNSystem has been shut down'
2013-08-12 14:44:59 [DEBUG   ] Got command RPT from MCS: ref #15331
2013-08-12 14:44:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 14:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15331  15 56516 53099415 ASHUTDWNSHUTDWN'
2013-08-12 14:44:59 [DEBUG   ] Got command RPT from MCS: ref #15332
2013-08-12 14:44:59 [DEBUG   ] info = System has been shut down
2013-08-12 14:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15332  33 56516 53099415 ASHUTDWNSystem has been shut down'
2013-08-12 14:49:59 [DEBUG   ] Got command RPT from MCS: ref #15349
2013-08-12 14:49:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 14:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15349  15 56516 53399407 ASHUTDWNSHUTDWN'
2013-08-12 14:49:59 [DEBUG   ] Got command RPT from MCS: ref #15350
2013-08-12 14:49:59 [DEBUG   ] info = System has been shut down
2013-08-12 14:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15350  33 56516 53399407 ASHUTDWNSystem has been shut down'
2013-08-12 14:54:59 [DEBUG   ] Got command RPT from MCS: ref #15366
2013-08-12 14:54:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 14:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15366  15 56516 53699415 ASHUTDWNSHUTDWN'
2013-08-12 14:54:59 [DEBUG   ] Got command RPT from MCS: ref #15367
2013-08-12 14:54:59 [DEBUG   ] info = System has been shut down
2013-08-12 14:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15367  33 56516 53699415 ASHUTDWNSystem has been shut down'
2013-08-12 14:59:59 [DEBUG   ] Got command RPT from MCS: ref #15383
2013-08-12 14:59:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 14:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15383  15 56516 53999419 ASHUTDWNSHUTDWN'
2013-08-12 14:59:59 [DEBUG   ] Got command RPT from MCS: ref #15384
2013-08-12 14:59:59 [DEBUG   ] info = System has been shut down
2013-08-12 14:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15384  33 56516 53999419 ASHUTDWNSystem has been shut down'
2013-08-12 15:04:59 [DEBUG   ] Got command RPT from MCS: ref #15400
2013-08-12 15:04:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 15:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15400  15 56516 54299415 ASHUTDWNSHUTDWN'
2013-08-12 15:04:59 [DEBUG   ] Got command RPT from MCS: ref #15401
2013-08-12 15:04:59 [DEBUG   ] info = System has been shut down
2013-08-12 15:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15401  33 56516 54299415 ASHUTDWNSystem has been shut down'
2013-08-12 15:09:59 [DEBUG   ] Got command RPT from MCS: ref #15417
2013-08-12 15:09:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 15:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15417  15 56516 54599415 ASHUTDWNSHUTDWN'
2013-08-12 15:09:59 [DEBUG   ] Got command RPT from MCS: ref #15418
2013-08-12 15:09:59 [DEBUG   ] info = System has been shut down
2013-08-12 15:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15418  33 56516 54599415 ASHUTDWNSystem has been shut down'
2013-08-12 15:14:59 [DEBUG   ] Got command RPT from MCS: ref #15434
2013-08-12 15:14:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 15:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15434  15 56516 54899423 ASHUTDWNSHUTDWN'
2013-08-12 15:14:59 [DEBUG   ] Got command RPT from MCS: ref #15435
2013-08-12 15:14:59 [DEBUG   ] info = System has been shut down
2013-08-12 15:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15435  33 56516 54899423 ASHUTDWNSystem has been shut down'
2013-08-12 15:19:59 [DEBUG   ] Got command RPT from MCS: ref #15451
2013-08-12 15:19:59 [DEBUG   ] summary = SHUTDWN
2013-08-12 15:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15451  15 56516 55199415 ASHUTDWNSHUTDWN'
2013-08-12 15:19:59 [DEBUG   ] Got command RPT from MCS: ref #15452
2013-08-12 15:19:59 [DEBUG   ] info = System has been shut down
2013-08-12 15:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15452  33 56516 55199415 ASHUTDWNSystem has been shut down'
2013-08-12 15:23:58 [DEBUG   ] Got command INI from MCS: ref #15469
2013-08-12 15:23:58 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2013-08-12 15:23:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    15469   8 56516 55438531 ABOOTING'
2013-08-12 15:24:17 [INFO    ] -------------------
2013-08-12 15:24:17 [INFO    ]  LWA board status
2013-08-12 15:24:17 [INFO    ] -------------------
2013-08-12 15:24:17 [INFO    ] DP 1: 2 lwa27
2013-08-12 15:24:17 [INFO    ] DP 1: 3 lwa24
2013-08-12 15:24:17 [INFO    ] DP 1: 4 lwa23
2013-08-12 15:24:17 [INFO    ] DP 1: 5 lwa18
2013-08-12 15:24:17 [INFO    ] DP 1: 6 lwa10
2013-08-12 15:24:17 [INFO    ] DP 1: 7 lwa32
2013-08-12 15:24:17 [INFO    ] DP 1: 8 lwa11
2013-08-12 15:24:17 [INFO    ] DP 1: 9 lwa30
2013-08-12 15:24:17 [INFO    ] DP 1: 10 lwa12
2013-08-12 15:24:17 [INFO    ] DP 1: 11 lwa8
2013-08-12 15:24:17 [INFO    ] DP 1: 12 lwa13
2013-08-12 15:24:17 [INFO    ] DP 1: 13 lwa26
2013-08-12 15:24:17 [INFO    ] DP 1: 14 lwa14
2013-08-12 15:24:17 [INFO    ] DP 1: 16 lwa22
2013-08-12 15:24:17 [INFO    ] DP 1: 17 lwa20
2013-08-12 15:24:17 [INFO    ] DP 1: 18 lwa1
2013-08-12 15:24:17 [INFO    ] DP 1: 19 lwa5
2013-08-12 15:24:17 [INFO    ] DP 1: 20 lwa25
2013-08-12 15:24:17 [INFO    ] DP 1: 21 lwa35
2013-08-12 15:24:17 [INFO    ] DP 1: 22 lwa19
2013-08-12 15:24:17 [INFO    ] DP 1: 23 lwa21
2013-08-12 15:24:17 [INFO    ] DP 1: 24 lwa6
2013-08-12 15:24:17 [INFO    ] DP 1: 25 lwa7
2013-08-12 15:24:17 [INFO    ] DP 1: 26 lwa33
2013-08-12 15:24:17 [INFO    ] DP 1: 27 lwa15
2013-08-12 15:24:17 [INFO    ] DP 1: 28 lwa28
2013-08-12 15:24:17 [INFO    ] DP 2: 1 lwa16
2013-08-12 15:24:17 [INFO    ] DP 2: 15 lwa34
2013-08-12 15:24:17 [INFO    ] Total of 28 boards
2013-08-12 15:24:17 [INFO    ] Total of 260 stands
2013-08-12 15:24:17 [INFO    ] -------------------
2013-08-12 15:24:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:17 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:18 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:19 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5861
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5862
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5863
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5864
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5865
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5866
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5867
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5868
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5869
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5870
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5871
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5872
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5873
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5874
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5875
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5876
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5877
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5878
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5879
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5880
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5881
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5882
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5883
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5884
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5885
2013-08-12 15:24:24 [DEBUG   ] 2013-08-12 15:24:24 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 5886
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5861 exited with status 0
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5862 exited with status 0
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5863 exited with status 0
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5864 exited with status 0
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5865 exited with status 0
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5866 exited with status 0
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5867 exited with status 0
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5868 exited with status 0
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5869 exited with status 0
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5870 exited with status 0
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5871 exited with status 0
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5872 exited with status 0
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5873 exited with status 0
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5874 exited with status 0
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5875 exited with status 0
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5876 exited with status 0
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5877 exited with status 0
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5878 exited with status 0
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5879 exited with status 0
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5880 exited with status 0
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5881 exited with status 0
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5882 exited with status 0
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5883 exited with status 0
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5884 exited with status 0
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5885 exited with status 0
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 5886 exited with status 0
2013-08-12 15:24:36 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] spawn_process: at 2013-08-12 15:24:36 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 5913
2013-08-12 15:24:36 [DEBUG   ] 2013-08-12 15:24:36 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 5914
2013-08-12 15:24:42 [DEBUG   ] 2013-08-12 15:24:42 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 5913 exited with status 0
2013-08-12 15:24:42 [DEBUG   ] 2013-08-12 15:24:42 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 5914 exited with status 0
2013-08-12 15:24:42 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2013-08-12 15:24:42 [DEBUG   ] spawn_process: at 2013-08-12 15:24:42 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2013-08-12 15:24:42 [DEBUG   ] spawn_process: at 2013-08-12 15:24:42 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2013-08-12 15:24:42 [INFO    ] Setting Beam 1 xbars
2013-08-12 15:24:42 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2013-08-12 15:24:42 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2013-08-12 15:24:42 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2013-08-12 15:24:42 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2013-08-12 15:24:42 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2013-08-12 15:24:42 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2013-08-12 15:24:43 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2013-08-12 15:24:43 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2013-08-12 15:24:43 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2013-08-12 15:24:43 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2013-08-12 15:24:43 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2013-08-12 15:24:43 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2013-08-12 15:24:43 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2013-08-12 15:24:43 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2013-08-12 15:24:43 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2013-08-12 15:24:44 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2013-08-12 15:24:44 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2013-08-12 15:24:44 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2013-08-12 15:24:44 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2013-08-12 15:24:44 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2013-08-12 15:24:44 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2013-08-12 15:24:44 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2013-08-12 15:24:44 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2013-08-12 15:24:44 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2013-08-12 15:24:45 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2013-08-12 15:24:45 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2013-08-12 15:24:45 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2013-08-12 15:24:45 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2013-08-12 15:24:45 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2013-08-12 15:24:45 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2013-08-12 15:24:45 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2013-08-12 15:24:45 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2013-08-12 15:24:45 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2013-08-12 15:24:45 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2013-08-12 15:24:46 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2013-08-12 15:24:46 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2013-08-12 15:24:46 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2013-08-12 15:24:46 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2013-08-12 15:24:46 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2013-08-12 15:24:46 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2013-08-12 15:24:46 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2013-08-12 15:24:46 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2013-08-12 15:24:46 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2013-08-12 15:24:47 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2013-08-12 15:24:47 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2013-08-12 15:24:47 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2013-08-12 15:24:47 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2013-08-12 15:24:47 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2013-08-12 15:24:47 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2013-08-12 15:24:47 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2013-08-12 15:24:47 [INFO    ] Setting Beam 2 xbars
2013-08-12 15:24:47 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2013-08-12 15:24:47 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2013-08-12 15:24:48 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2013-08-12 15:24:48 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2013-08-12 15:24:48 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2013-08-12 15:24:48 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2013-08-12 15:24:48 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2013-08-12 15:24:48 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2013-08-12 15:24:48 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2013-08-12 15:24:48 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2013-08-12 15:24:48 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2013-08-12 15:24:48 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2013-08-12 15:24:49 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2013-08-12 15:24:49 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2013-08-12 15:24:49 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2013-08-12 15:24:49 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2013-08-12 15:24:49 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2013-08-12 15:24:49 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2013-08-12 15:24:49 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2013-08-12 15:24:49 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2013-08-12 15:24:49 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2013-08-12 15:24:50 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2013-08-12 15:24:50 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2013-08-12 15:24:50 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2013-08-12 15:24:50 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2013-08-12 15:24:50 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2013-08-12 15:24:50 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2013-08-12 15:24:50 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2013-08-12 15:24:50 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2013-08-12 15:24:50 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2013-08-12 15:24:51 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2013-08-12 15:24:51 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2013-08-12 15:24:51 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2013-08-12 15:24:51 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2013-08-12 15:24:51 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2013-08-12 15:24:51 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2013-08-12 15:24:51 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2013-08-12 15:24:51 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2013-08-12 15:24:51 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2013-08-12 15:24:51 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2013-08-12 15:24:52 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2013-08-12 15:24:52 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2013-08-12 15:24:52 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2013-08-12 15:24:52 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2013-08-12 15:24:52 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2013-08-12 15:24:52 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2013-08-12 15:24:52 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2013-08-12 15:24:52 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2013-08-12 15:24:52 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2013-08-12 15:24:53 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2013-08-12 15:24:53 [INFO    ] Setting Beam 3 xbars
2013-08-12 15:24:53 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2013-08-12 15:24:53 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2013-08-12 15:24:53 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2013-08-12 15:24:53 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2013-08-12 15:24:53 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2013-08-12 15:24:53 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2013-08-12 15:24:53 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2013-08-12 15:24:53 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2013-08-12 15:24:54 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2013-08-12 15:24:54 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2013-08-12 15:24:54 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2013-08-12 15:24:54 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2013-08-12 15:24:54 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2013-08-12 15:24:54 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2013-08-12 15:24:54 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2013-08-12 15:24:54 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2013-08-12 15:24:54 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2013-08-12 15:24:55 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2013-08-12 15:24:55 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2013-08-12 15:24:55 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2013-08-12 15:24:55 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2013-08-12 15:24:55 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2013-08-12 15:24:55 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2013-08-12 15:24:55 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2013-08-12 15:24:55 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2013-08-12 15:24:55 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2013-08-12 15:24:55 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2013-08-12 15:24:56 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2013-08-12 15:24:56 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2013-08-12 15:24:56 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2013-08-12 15:24:56 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2013-08-12 15:24:56 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2013-08-12 15:24:56 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2013-08-12 15:24:56 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2013-08-12 15:24:56 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2013-08-12 15:24:56 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2013-08-12 15:24:57 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2013-08-12 15:24:57 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2013-08-12 15:24:57 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2013-08-12 15:24:57 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2013-08-12 15:24:57 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2013-08-12 15:24:57 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2013-08-12 15:24:57 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2013-08-12 15:24:57 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2013-08-12 15:24:57 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2013-08-12 15:24:58 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2013-08-12 15:24:58 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2013-08-12 15:24:58 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2013-08-12 15:24:58 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2013-08-12 15:24:58 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2013-08-12 15:24:58 [INFO    ] Setting Beam 4 xbars
2013-08-12 15:24:58 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2013-08-12 15:24:58 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2013-08-12 15:24:58 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2013-08-12 15:24:58 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2013-08-12 15:24:58 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2013-08-12 15:24:59 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2013-08-12 15:24:59 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2013-08-12 15:24:59 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2013-08-12 15:24:59 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2013-08-12 15:24:59 [DEBUG   ] Got command RPT from MCS: ref #15470
2013-08-12 15:24:59 [DEBUG   ] summary = BOOTING
2013-08-12 15:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15470  15 56516 55499423 ABOOTINGBOOTING'
2013-08-12 15:24:59 [DEBUG   ] Got command RPT from MCS: ref #15471
2013-08-12 15:24:59 [DEBUG   ] info = Starting calibration
2013-08-12 15:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15471  28 56516 55499424 ABOOTINGStarting calibration'
2013-08-12 15:24:59 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2013-08-12 15:24:59 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2013-08-12 15:24:59 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2013-08-12 15:24:59 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2013-08-12 15:24:59 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2013-08-12 15:25:00 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2013-08-12 15:25:00 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2013-08-12 15:25:00 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2013-08-12 15:25:00 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2013-08-12 15:25:00 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2013-08-12 15:25:00 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2013-08-12 15:25:00 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2013-08-12 15:25:00 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2013-08-12 15:25:00 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2013-08-12 15:25:01 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2013-08-12 15:25:01 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2013-08-12 15:25:01 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2013-08-12 15:25:01 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2013-08-12 15:25:01 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2013-08-12 15:25:01 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2013-08-12 15:25:01 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2013-08-12 15:25:01 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2013-08-12 15:25:01 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2013-08-12 15:25:02 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2013-08-12 15:25:02 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2013-08-12 15:25:02 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2013-08-12 15:25:02 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2013-08-12 15:25:02 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2013-08-12 15:25:02 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2013-08-12 15:25:02 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2013-08-12 15:25:02 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2013-08-12 15:25:02 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2013-08-12 15:25:03 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2013-08-12 15:25:03 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2013-08-12 15:25:03 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2013-08-12 15:25:03 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2013-08-12 15:25:03 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2013-08-12 15:25:03 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2013-08-12 15:25:03 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2013-08-12 15:25:03 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2013-08-12 15:25:03 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2013-08-12 15:25:04 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2013-08-12 15:25:04 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2013-08-12 15:25:04 [INFO    ] All xbars set
2013-08-12 15:25:04 [INFO    ] Setting adder chain routing for all beams
2013-08-12 15:25:08 [INFO    ] Setting beam ids
2013-08-12 15:25:19 [INFO    ] Starting beam delay calibration
2013-08-12 15:25:31 [INFO    ] Beam 1 latency is 5714
2013-08-12 15:25:31 [INFO    ] Beam 2 latency is 5747
2013-08-12 15:25:31 [INFO    ] Beam 3 latency is 5727
2013-08-12 15:25:31 [INFO    ] Beam 4 latency is 5719
2013-08-12 15:25:31 [INFO    ] Stop calibration
2013-08-12 15:25:38 [INFO    ] Beam delay calibration successful
2013-08-12 15:25:38 [INFO    ] Calibration passed
2013-08-12 15:25:38 [DEBUG   ] spawn_process: at 2013-08-12 15:25:38 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2013-08-12 15:25:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2013-08-12 15:25:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2013-08-12 15:25:39 [DEBUG   ] spawn_process: at 2013-08-12 15:25:39 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2013-08-12 15:25:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2013-08-12 15:25:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2013-08-12 15:25:39 [DEBUG   ] spawn_process: at 2013-08-12 15:25:39 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2013-08-12 15:25:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2013-08-12 15:25:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2013-08-12 15:25:39 [DEBUG   ] spawn_process: at 2013-08-12 15:25:39 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2013-08-12 15:25:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2013-08-12 15:25:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2013-08-12 15:25:39 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -5 msec
2013-08-12 15:25:39 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 377 ms (1376321139.381 s) with PID 7479 and time 1376321140
2013-08-12 15:25:39 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -5 msec
2013-08-12 15:25:39 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 465 ms (1376321139.469 s) with PID 7482 and time 1376321140
2013-08-12 15:25:40 [DEBUG   ] Finished updating ant stats in 0.779 seconds
2013-08-12 15:25:40 [INFO    ] Started antennas statistics background thread
2013-08-12 15:25:40 [INFO    ] Started board flags background thread
2013-08-12 15:25:40 [INFO    ] Started BAM background thread
2013-08-12 15:25:40 [INFO    ] Finished the INI process (ref. #15469) in 102.061 s
2013-08-12 15:25:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-08-12 15:25:41 [DEBUG   ] Finished updating board flags in 1.406 seconds
2013-08-12 15:26:00 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2013-08-12 15:26:20 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-08-12 15:26:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-08-12 15:26:41 [DEBUG   ] Finished updating board flags in 1.395 seconds
2013-08-12 15:27:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-12 15:27:02 [DEBUG   ] Got command RPT from MCS: ref #15526
2013-08-12 15:27:02 [DEBUG   ] summary = NORMAL
2013-08-12 15:27:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15526  14 56516 55622539 A NORMALNORMAL'
2013-08-12 15:27:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-12 15:27:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-12 15:27:41 [DEBUG   ] Finished updating board flags in 1.245 seconds
2013-08-12 15:28:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-12 15:28:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-12 15:28:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-12 15:28:42 [DEBUG   ] Finished updating board flags in 1.796 seconds
2013-08-12 15:28:49 [DEBUG   ] Got command TBN from MCS: ref #15527
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '1', '1376321331']
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '2', '1376321331']
2013-08-12 15:28:49 [DEBUG   ] tbn = exited with status True, code 0x00
2013-08-12 15:28:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN    15527   8 56516 55729615 A NORMAL'
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '3', '1376321331']
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '4', '1376321331']
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '5', '1376321331']
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '6', '1376321331']
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '7', '1376321331']
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '8', '1376321331']
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '9', '1376321331']
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '10', '1376321331']
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '11', '1376321331']
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '12', '1376321331']
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '13', '1376321331']
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '14', '1376321331']
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '15', '1376321331']
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '16', '1376321331']
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '17', '1376321331']
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '18', '1376321331']
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '19', '1376321331']
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '20', '1376321331']
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '21', '1376321331']
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '22', '1376321331']
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '23', '1376321331']
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '24', '1376321331']
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '25', '1376321331']
2013-08-12 15:28:49 [DEBUG   ] spawn_process: at 2013-08-12 15:28:49 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '26', '1376321331']
2013-08-12 15:28:49 [INFO    ] Finished spawning TBN in 0.047 s
2013-08-12 15:29:00 [DEBUG   ] Finished updating ant stats in 0.470 seconds
2013-08-12 15:29:20 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-08-12 15:29:40 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2013-08-12 15:29:42 [DEBUG   ] Finished updating board flags in 1.837 seconds
2013-08-12 15:29:59 [DEBUG   ] Got command RPT from MCS: ref #15528
2013-08-12 15:29:59 [DEBUG   ] summary = NORMAL
2013-08-12 15:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15528  14 56516 55799423 A NORMALNORMAL'
2013-08-12 15:29:59 [DEBUG   ] Got command RPT from MCS: ref #15529
2013-08-12 15:29:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 15:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15529  48 56516 55799423 A NORMALSystem calibrated and operating normally'
2013-08-12 15:30:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 15:30:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 15:30:41 [DEBUG   ] Finished updating ant stats in 1.246 seconds
2013-08-12 15:30:42 [DEBUG   ] Finished updating board flags in 1.697 seconds
2013-08-12 15:30:54 [DEBUG   ] Got command TBW from MCS: ref #15546
2013-08-12 15:30:54 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-12 15:30:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    15546   8 56516 55854375 A NORMAL'
2013-08-12 15:30:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-12 15:30:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-12 15:30:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-12 15:30:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-12 15:30:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-12 15:30:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-12 15:30:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-12 15:30:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-12 15:30:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-12 15:30:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-12 15:30:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-12 15:30:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-12 15:30:56 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-12 15:30:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-12 15:30:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-12 15:30:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-12 15:30:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-12 15:30:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-12 15:30:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-12 15:30:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-12 15:30:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-12 15:30:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-12 15:30:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-12 15:30:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-12 15:30:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-12 15:30:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-12 15:30:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-12 15:30:57 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-12 15:30:57 [DEBUG   ] spawn_process: at 2013-08-12 15:30:57 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-12 15:30:57 [DEBUG   ] spawn_process: at 2013-08-12 15:30:57 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-12 15:30:57 [DEBUG   ] spawn_process: at 2013-08-12 15:30:57 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-12 15:30:57 [DEBUG   ] spawn_process: at 2013-08-12 15:30:57 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-12 15:30:57 [DEBUG   ] spawn_process: at 2013-08-12 15:30:57 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-12 15:30:57 [DEBUG   ] spawn_process: at 2013-08-12 15:30:57 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-12 15:30:57 [DEBUG   ] spawn_process: at 2013-08-12 15:30:57 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-12 15:30:57 [DEBUG   ] spawn_process: at 2013-08-12 15:30:57 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-12 15:30:57 [DEBUG   ] spawn_process: at 2013-08-12 15:30:57 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-12 15:30:57 [DEBUG   ] spawn_process: at 2013-08-12 15:30:57 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-12 15:30:57 [DEBUG   ] spawn_process: at 2013-08-12 15:30:57 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-12 15:30:57 [DEBUG   ] spawn_process: at 2013-08-12 15:30:57 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-12 15:30:57 [DEBUG   ] spawn_process: at 2013-08-12 15:30:57 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-12 15:30:57 [DEBUG   ] spawn_process: at 2013-08-12 15:30:57 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-12 15:30:57 [DEBUG   ] spawn_process: at 2013-08-12 15:30:57 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-12 15:30:57 [DEBUG   ] spawn_process: at 2013-08-12 15:30:57 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-12 15:30:57 [DEBUG   ] spawn_process: at 2013-08-12 15:30:57 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-12 15:30:57 [DEBUG   ] spawn_process: at 2013-08-12 15:30:57 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-12 15:30:57 [DEBUG   ] spawn_process: at 2013-08-12 15:30:57 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-12 15:30:57 [DEBUG   ] spawn_process: at 2013-08-12 15:30:57 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-12 15:30:57 [DEBUG   ] spawn_process: at 2013-08-12 15:30:57 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-12 15:30:57 [DEBUG   ] spawn_process: at 2013-08-12 15:30:57 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-12 15:30:58 [DEBUG   ] spawn_process: at 2013-08-12 15:30:58 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-12 15:30:58 [DEBUG   ] spawn_process: at 2013-08-12 15:30:58 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-12 15:30:58 [DEBUG   ] spawn_process: at 2013-08-12 15:30:58 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-12 15:30:58 [DEBUG   ] spawn_process: at 2013-08-12 15:30:58 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-12 15:30:58 [INFO    ] Finished spawning TBW
2013-08-12 15:31:42 [DEBUG   ] Finished updating board flags in 1.445 seconds
2013-08-12 15:32:42 [DEBUG   ] Finished updating board flags in 1.486 seconds
2013-08-12 15:33:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2013-08-12 15:33:42 [DEBUG   ] Finished updating board flags in 1.281 seconds
2013-08-12 15:34:36 [INFO    ] __waitForTBW - TBW finished in 218.836 s
2013-08-12 15:34:37 [DEBUG   ] Finished updating ant stats in 0.451 seconds
2013-08-12 15:34:37 [INFO    ] Started antennas statistics background thread
2013-08-12 15:34:37 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '1', '1376321679']
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '2', '1376321679']
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '3', '1376321679']
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '4', '1376321679']
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '5', '1376321679']
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '6', '1376321679']
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '7', '1376321679']
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '8', '1376321679']
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '9', '1376321679']
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '10', '1376321679']
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '11', '1376321679']
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '12', '1376321679']
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '13', '1376321679']
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '14', '1376321679']
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '15', '1376321679']
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '16', '1376321679']
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '17', '1376321679']
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '18', '1376321679']
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '19', '1376321679']
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '20', '1376321679']
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '21', '1376321679']
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '22', '1376321679']
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '23', '1376321679']
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '24', '1376321679']
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '25', '1376321679']
2013-08-12 15:34:37 [DEBUG   ] spawn_process: at 2013-08-12 15:34:37 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '20', '0', '26', '1376321679']
2013-08-12 15:34:37 [INFO    ] Finished spawning TBN in 0.047 s
2013-08-12 15:34:42 [DEBUG   ] Finished updating board flags in 1.214 seconds
2013-08-12 15:34:57 [DEBUG   ] Finished updating ant stats in 0.470 seconds
2013-08-12 15:34:59 [DEBUG   ] Got command RPT from MCS: ref #15557
2013-08-12 15:34:59 [DEBUG   ] summary = NORMAL
2013-08-12 15:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15557  14 56516 56099423 A NORMALNORMAL'
2013-08-12 15:34:59 [DEBUG   ] Got command RPT from MCS: ref #15558
2013-08-12 15:34:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 15:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15558  48 56516 56099423 A NORMALSystem calibrated and operating normally'
2013-08-12 15:35:17 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-12 15:35:38 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-08-12 15:35:42 [DEBUG   ] Finished updating board flags in 1.490 seconds
2013-08-12 15:35:58 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-12 15:36:18 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-12 15:36:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 15:36:42 [DEBUG   ] Finished updating board flags in 1.506 seconds
2013-08-12 15:36:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 15:37:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 15:37:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-12 15:37:43 [DEBUG   ] Finished updating board flags in 2.213 seconds
2013-08-12 15:37:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 15:38:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-12 15:38:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 15:38:43 [DEBUG   ] Finished updating board flags in 2.212 seconds
2013-08-12 15:38:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 15:39:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 15:39:38 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-12 15:39:43 [DEBUG   ] Finished updating board flags in 2.171 seconds
2013-08-12 15:39:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 15:39:59 [DEBUG   ] Got command RPT from MCS: ref #15574
2013-08-12 15:39:59 [DEBUG   ] summary = NORMAL
2013-08-12 15:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15574  14 56516 56399423 A NORMALNORMAL'
2013-08-12 15:39:59 [DEBUG   ] Got command RPT from MCS: ref #15575
2013-08-12 15:39:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 15:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15575  48 56516 56399423 A NORMALSystem calibrated and operating normally'
2013-08-12 15:40:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 15:40:38 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-12 15:40:43 [DEBUG   ] Finished updating board flags in 2.014 seconds
2013-08-12 15:40:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 15:41:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-12 15:41:39 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-08-12 15:41:43 [DEBUG   ] Finished updating board flags in 1.997 seconds
2013-08-12 15:41:58 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-12 15:42:18 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-08-12 15:42:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 15:42:43 [DEBUG   ] Finished updating board flags in 1.798 seconds
2013-08-12 15:42:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 15:43:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 15:43:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 15:43:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2013-08-12 15:43:43 [DEBUG   ] Finished updating board flags in 1.596 seconds
2013-08-12 15:43:59 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-12 15:44:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 15:44:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-12 15:44:43 [DEBUG   ] Finished updating board flags in 1.475 seconds
2013-08-12 15:44:59 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-12 15:44:59 [DEBUG   ] Got command RPT from MCS: ref #15591
2013-08-12 15:44:59 [DEBUG   ] summary = NORMAL
2013-08-12 15:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15591  14 56516 56699427 A NORMALNORMAL'
2013-08-12 15:44:59 [DEBUG   ] Got command RPT from MCS: ref #15592
2013-08-12 15:44:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 15:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15592  48 56516 56699427 A NORMALSystem calibrated and operating normally'
2013-08-12 15:45:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 15:45:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 15:45:43 [DEBUG   ] Finished updating board flags in 1.420 seconds
2013-08-12 15:45:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-12 15:46:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-12 15:46:40 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-08-12 15:46:44 [DEBUG   ] Finished updating board flags in 2.375 seconds
2013-08-12 15:47:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 15:47:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 15:47:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 15:47:44 [DEBUG   ] Finished updating board flags in 2.212 seconds
2013-08-12 15:48:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 15:48:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 15:48:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 15:48:44 [DEBUG   ] Finished updating board flags in 2.118 seconds
2013-08-12 15:49:00 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-12 15:49:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 15:49:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-12 15:49:44 [DEBUG   ] Finished updating board flags in 2.009 seconds
2013-08-12 15:49:59 [DEBUG   ] Got command RPT from MCS: ref #15608
2013-08-12 15:49:59 [DEBUG   ] summary = NORMAL
2013-08-12 15:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15608  14 56516 56999431 A NORMALNORMAL'
2013-08-12 15:49:59 [DEBUG   ] Got command RPT from MCS: ref #15609
2013-08-12 15:49:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 15:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15609  48 56516 56999431 A NORMALSystem calibrated and operating normally'
2013-08-12 15:50:00 [DEBUG   ] Finished updating ant stats in 0.592 seconds
2013-08-12 15:50:20 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-08-12 15:50:41 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-08-12 15:50:44 [DEBUG   ] Finished updating board flags in 2.011 seconds
2013-08-12 15:51:01 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-08-12 15:51:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 15:51:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 15:51:44 [DEBUG   ] Finished updating board flags in 1.985 seconds
2013-08-12 15:52:01 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 15:52:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 15:52:41 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-12 15:52:44 [DEBUG   ] Finished updating board flags in 1.816 seconds
2013-08-12 15:53:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 15:53:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-12 15:53:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 15:53:44 [DEBUG   ] Finished updating board flags in 1.780 seconds
2013-08-12 15:54:01 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2013-08-12 15:54:21 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2013-08-12 15:54:42 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-08-12 15:54:44 [DEBUG   ] Finished updating board flags in 1.620 seconds
2013-08-12 15:54:59 [DEBUG   ] Got command RPT from MCS: ref #15625
2013-08-12 15:54:59 [DEBUG   ] summary = NORMAL
2013-08-12 15:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15625  14 56516 57299427 A NORMALNORMAL'
2013-08-12 15:54:59 [DEBUG   ] Got command RPT from MCS: ref #15626
2013-08-12 15:54:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 15:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15626  48 56516 57299427 A NORMALSystem calibrated and operating normally'
2013-08-12 15:55:02 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2013-08-12 15:55:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 15:55:42 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 15:55:44 [DEBUG   ] Finished updating board flags in 1.590 seconds
2013-08-12 15:56:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-12 15:56:22 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-12 15:56:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 15:56:44 [DEBUG   ] Finished updating board flags in 1.409 seconds
2013-08-12 15:57:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 15:57:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 15:57:42 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-12 15:57:44 [DEBUG   ] Finished updating board flags in 1.382 seconds
2013-08-12 15:58:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 15:58:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-12 15:58:43 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-08-12 15:58:44 [DEBUG   ] Finished updating board flags in 1.347 seconds
2013-08-12 15:59:03 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-08-12 15:59:23 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-08-12 15:59:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 15:59:45 [DEBUG   ] Finished updating board flags in 2.077 seconds
2013-08-12 15:59:59 [DEBUG   ] Got command RPT from MCS: ref #15642
2013-08-12 15:59:59 [DEBUG   ] summary = NORMAL
2013-08-12 15:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15642  14 56516 57599427 A NORMALNORMAL'
2013-08-12 15:59:59 [DEBUG   ] Got command RPT from MCS: ref #15643
2013-08-12 15:59:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 15:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15643  48 56516 57599427 A NORMALSystem calibrated and operating normally'
2013-08-12 16:00:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 16:00:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 16:00:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-12 16:00:45 [DEBUG   ] Finished updating board flags in 1.989 seconds
2013-08-12 16:01:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 16:01:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 16:01:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-12 16:01:45 [DEBUG   ] Finished updating board flags in 1.841 seconds
2013-08-12 16:02:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 16:02:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 16:02:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 16:02:45 [DEBUG   ] Finished updating board flags in 1.759 seconds
2013-08-12 16:03:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-12 16:03:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 16:03:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 16:03:45 [DEBUG   ] Finished updating board flags in 1.619 seconds
2013-08-12 16:04:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 16:04:23 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 16:04:44 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-08-12 16:04:45 [DEBUG   ] Finished updating board flags in 1.582 seconds
2013-08-12 16:04:59 [DEBUG   ] Got command RPT from MCS: ref #15659
2013-08-12 16:04:59 [DEBUG   ] summary = NORMAL
2013-08-12 16:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15659  14 56516 57899435 A NORMALNORMAL'
2013-08-12 16:04:59 [DEBUG   ] Got command RPT from MCS: ref #15660
2013-08-12 16:04:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 16:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15660  48 56516 57899436 A NORMALSystem calibrated and operating normally'
2013-08-12 16:05:04 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-12 16:05:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 16:05:44 [DEBUG   ] Finished updating ant stats in 1.050 seconds
2013-08-12 16:05:45 [DEBUG   ] Finished updating board flags in 1.418 seconds
2013-08-12 16:06:04 [DEBUG   ] Finished updating ant stats in 0.957 seconds
2013-08-12 16:06:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 16:06:44 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2013-08-12 16:06:45 [DEBUG   ] Finished updating board flags in 1.406 seconds
2013-08-12 16:07:04 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2013-08-12 16:07:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 16:07:44 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2013-08-12 16:07:45 [DEBUG   ] Finished updating board flags in 1.393 seconds
2013-08-12 16:08:04 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2013-08-12 16:08:24 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-08-12 16:08:45 [DEBUG   ] Finished updating ant stats in 1.249 seconds
2013-08-12 16:08:45 [DEBUG   ] Finished updating board flags in 1.426 seconds
2013-08-12 16:09:05 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2013-08-12 16:09:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 16:09:45 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2013-08-12 16:09:46 [DEBUG   ] Finished updating board flags in 2.186 seconds
2013-08-12 16:09:59 [DEBUG   ] Got command RPT from MCS: ref #15676
2013-08-12 16:09:59 [DEBUG   ] summary = NORMAL
2013-08-12 16:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15676  14 56516 58199435 A NORMALNORMAL'
2013-08-12 16:09:59 [DEBUG   ] Got command RPT from MCS: ref #15677
2013-08-12 16:09:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 16:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15677  48 56516 58199435 A NORMALSystem calibrated and operating normally'
2013-08-12 16:10:05 [DEBUG   ] Finished updating ant stats in 0.953 seconds
2013-08-12 16:10:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 16:10:45 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2013-08-12 16:10:46 [DEBUG   ] Finished updating board flags in 1.991 seconds
2013-08-12 16:11:05 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2013-08-12 16:11:25 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-08-12 16:11:46 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-08-12 16:11:46 [DEBUG   ] Finished updating board flags in 1.810 seconds
2013-08-12 16:12:06 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-08-12 16:12:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 16:12:46 [DEBUG   ] Finished updating ant stats in 1.243 seconds
2013-08-12 16:12:46 [DEBUG   ] Finished updating board flags in 1.857 seconds
2013-08-12 16:13:06 [DEBUG   ] Finished updating ant stats in 1.160 seconds
2013-08-12 16:13:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 16:13:46 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2013-08-12 16:13:46 [DEBUG   ] Finished updating board flags in 1.797 seconds
2013-08-12 16:14:06 [DEBUG   ] Finished updating ant stats in 0.956 seconds
2013-08-12 16:14:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 16:14:46 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2013-08-12 16:14:46 [DEBUG   ] Finished updating board flags in 1.602 seconds
2013-08-12 16:14:59 [DEBUG   ] Got command RPT from MCS: ref #15693
2013-08-12 16:14:59 [DEBUG   ] summary = NORMAL
2013-08-12 16:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15693  14 56516 58499431 A NORMALNORMAL'
2013-08-12 16:14:59 [DEBUG   ] Got command RPT from MCS: ref #15694
2013-08-12 16:14:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 16:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15694  48 56516 58499431 A NORMALSystem calibrated and operating normally'
2013-08-12 16:15:06 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2013-08-12 16:15:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 16:15:46 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2013-08-12 16:15:46 [DEBUG   ] Finished updating board flags in 1.600 seconds
2013-08-12 16:16:06 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2013-08-12 16:16:26 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-08-12 16:16:46 [DEBUG   ] Finished updating ant stats in 0.445 seconds
2013-08-12 16:16:46 [DEBUG   ] Finished updating board flags in 1.602 seconds
2013-08-12 16:17:07 [DEBUG   ] Finished updating ant stats in 1.358 seconds
2013-08-12 16:17:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 16:17:46 [DEBUG   ] Finished updating board flags in 1.596 seconds
2013-08-12 16:17:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 16:18:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 16:18:27 [DEBUG   ] Finished updating ant stats in 0.935 seconds
2013-08-12 16:18:46 [DEBUG   ] Finished updating board flags in 1.415 seconds
2013-08-12 16:18:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 16:19:07 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-12 16:19:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 16:19:46 [DEBUG   ] Finished updating board flags in 1.374 seconds
2013-08-12 16:19:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 16:19:59 [DEBUG   ] Got command RPT from MCS: ref #15710
2013-08-12 16:19:59 [DEBUG   ] summary = NORMAL
2013-08-12 16:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15710  14 56516 58799439 A NORMALNORMAL'
2013-08-12 16:19:59 [DEBUG   ] Got command RPT from MCS: ref #15711
2013-08-12 16:19:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 16:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15711  48 56516 58799439 A NORMALSystem calibrated and operating normally'
2013-08-12 16:20:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 16:20:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 16:20:47 [DEBUG   ] Finished updating ant stats in 0.652 seconds
2013-08-12 16:20:47 [DEBUG   ] Finished updating board flags in 2.284 seconds
2013-08-12 16:21:07 [DEBUG   ] Finished updating ant stats in 0.550 seconds
2013-08-12 16:21:27 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-08-12 16:21:47 [DEBUG   ] Finished updating board flags in 2.147 seconds
2013-08-12 16:21:48 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-08-12 16:22:08 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-12 16:22:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 16:22:47 [DEBUG   ] Finished updating board flags in 1.997 seconds
2013-08-12 16:22:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 16:23:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 16:23:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 16:23:47 [DEBUG   ] Finished updating board flags in 1.818 seconds
2013-08-12 16:23:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 16:24:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 16:24:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 16:24:47 [DEBUG   ] Finished updating board flags in 1.850 seconds
2013-08-12 16:24:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 16:24:59 [DEBUG   ] Got command RPT from MCS: ref #15727
2013-08-12 16:24:59 [DEBUG   ] summary = NORMAL
2013-08-12 16:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15727  14 56516 59099431 A NORMALNORMAL'
2013-08-12 16:24:59 [DEBUG   ] Got command RPT from MCS: ref #15728
2013-08-12 16:24:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 16:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15728  48 56516 59099431 A NORMALSystem calibrated and operating normally'
2013-08-12 16:25:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 16:25:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 16:25:47 [DEBUG   ] Finished updating board flags in 1.787 seconds
2013-08-12 16:25:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 16:26:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 16:26:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 16:26:47 [DEBUG   ] Finished updating board flags in 1.630 seconds
2013-08-12 16:26:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 16:27:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 16:27:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 16:27:47 [DEBUG   ] Finished updating board flags in 1.513 seconds
2013-08-12 16:27:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 16:28:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 16:28:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 16:28:47 [DEBUG   ] Finished updating board flags in 1.528 seconds
2013-08-12 16:28:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 16:29:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 16:29:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 16:29:47 [DEBUG   ] Finished updating board flags in 1.535 seconds
2013-08-12 16:29:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-12 16:29:59 [DEBUG   ] Got command RPT from MCS: ref #15744
2013-08-12 16:29:59 [DEBUG   ] summary = NORMAL
2013-08-12 16:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15744  14 56516 59399435 A NORMALNORMAL'
2013-08-12 16:29:59 [DEBUG   ] Got command RPT from MCS: ref #15745
2013-08-12 16:29:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 16:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15745  48 56516 59399435 A NORMALSystem calibrated and operating normally'
2013-08-12 16:30:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 16:30:28 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 16:30:48 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2013-08-12 16:30:48 [DEBUG   ] Finished updating board flags in 2.159 seconds
2013-08-12 16:31:08 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2013-08-12 16:31:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 16:31:48 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2013-08-12 16:31:48 [DEBUG   ] Finished updating board flags in 2.025 seconds
2013-08-12 16:32:08 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2013-08-12 16:32:29 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-08-12 16:32:48 [DEBUG   ] Finished updating board flags in 1.942 seconds
2013-08-12 16:32:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 16:33:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 16:33:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 16:33:48 [DEBUG   ] Finished updating board flags in 1.836 seconds
2013-08-12 16:33:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 16:34:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 16:34:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 16:34:48 [DEBUG   ] Finished updating board flags in 1.848 seconds
2013-08-12 16:34:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 16:34:59 [DEBUG   ] Got command RPT from MCS: ref #15761
2013-08-12 16:34:59 [DEBUG   ] summary = NORMAL
2013-08-12 16:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15761  14 56516 59699443 A NORMALNORMAL'
2013-08-12 16:34:59 [DEBUG   ] Got command RPT from MCS: ref #15762
2013-08-12 16:34:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 16:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15762  48 56516 59699443 A NORMALSystem calibrated and operating normally'
2013-08-12 16:35:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 16:35:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 16:35:48 [DEBUG   ] Finished updating board flags in 1.833 seconds
2013-08-12 16:35:49 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2013-08-12 16:36:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-12 16:36:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 16:36:48 [DEBUG   ] Finished updating board flags in 1.710 seconds
2013-08-12 16:36:49 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 16:37:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 16:37:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 16:37:48 [DEBUG   ] Finished updating board flags in 1.618 seconds
2013-08-12 16:37:49 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 16:38:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 16:38:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 16:38:48 [DEBUG   ] Finished updating board flags in 1.619 seconds
2013-08-12 16:38:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 16:39:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 16:39:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 16:39:48 [DEBUG   ] Finished updating board flags in 1.574 seconds
2013-08-12 16:39:49 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2013-08-12 16:39:59 [DEBUG   ] Got command RPT from MCS: ref #15778
2013-08-12 16:39:59 [DEBUG   ] summary = NORMAL
2013-08-12 16:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15778  14 56516 59999443 A NORMALNORMAL'
2013-08-12 16:39:59 [DEBUG   ] Got command RPT from MCS: ref #15779
2013-08-12 16:39:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 16:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15779  48 56516 59999443 A NORMALSystem calibrated and operating normally'
2013-08-12 16:40:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 16:40:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 16:40:48 [DEBUG   ] Finished updating board flags in 1.515 seconds
2013-08-12 16:40:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 16:41:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 16:41:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 16:41:48 [DEBUG   ] Finished updating board flags in 1.576 seconds
2013-08-12 16:41:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 16:42:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 16:42:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 16:42:49 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2013-08-12 16:42:49 [DEBUG   ] Finished updating board flags in 2.175 seconds
2013-08-12 16:43:09 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2013-08-12 16:43:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 16:43:49 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2013-08-12 16:43:49 [DEBUG   ] Finished updating board flags in 1.963 seconds
2013-08-12 16:44:09 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2013-08-12 16:44:29 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-12 16:44:49 [DEBUG   ] Finished updating board flags in 1.790 seconds
2013-08-12 16:44:50 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-08-12 16:44:59 [DEBUG   ] Got command RPT from MCS: ref #15812
2013-08-12 16:44:59 [DEBUG   ] summary = NORMAL
2013-08-12 16:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15812  14 56516 60299435 A NORMALNORMAL'
2013-08-12 16:44:59 [DEBUG   ] Got command RPT from MCS: ref #15813
2013-08-12 16:44:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 16:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15813  48 56516 60299435 A NORMALSystem calibrated and operating normally'
2013-08-12 16:45:10 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-12 16:45:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 16:45:49 [DEBUG   ] Finished updating board flags in 1.628 seconds
2013-08-12 16:45:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 16:46:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 16:46:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 16:46:49 [DEBUG   ] Finished updating board flags in 1.582 seconds
2013-08-12 16:46:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 16:47:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 16:47:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 16:47:49 [DEBUG   ] Finished updating board flags in 1.448 seconds
2013-08-12 16:47:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 16:48:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 16:48:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 16:48:49 [DEBUG   ] Finished updating board flags in 1.456 seconds
2013-08-12 16:48:50 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2013-08-12 16:49:10 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-12 16:49:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 16:49:49 [DEBUG   ] Finished updating board flags in 1.484 seconds
2013-08-12 16:49:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 16:49:59 [DEBUG   ] Got command RPT from MCS: ref #15881
2013-08-12 16:49:59 [DEBUG   ] summary = NORMAL
2013-08-12 16:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15881  14 56516 60599435 A NORMALNORMAL'
2013-08-12 16:49:59 [DEBUG   ] Got command RPT from MCS: ref #15882
2013-08-12 16:49:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 16:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15882  48 56516 60599435 A NORMALSystem calibrated and operating normally'
2013-08-12 16:50:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 16:50:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 16:50:50 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2013-08-12 16:50:50 [DEBUG   ] Finished updating board flags in 2.263 seconds
2013-08-12 16:51:10 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2013-08-12 16:51:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 16:51:50 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2013-08-12 16:51:50 [DEBUG   ] Finished updating board flags in 2.136 seconds
2013-08-12 16:52:10 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2013-08-12 16:52:30 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-08-12 16:52:50 [DEBUG   ] Finished updating ant stats in 0.447 seconds
2013-08-12 16:52:50 [DEBUG   ] Finished updating board flags in 2.040 seconds
2013-08-12 16:53:11 [DEBUG   ] Finished updating ant stats in 1.357 seconds
2013-08-12 16:53:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 16:53:50 [DEBUG   ] Finished updating board flags in 1.980 seconds
2013-08-12 16:53:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 16:54:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 16:54:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 16:54:50 [DEBUG   ] Finished updating board flags in 1.836 seconds
2013-08-12 16:54:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 16:54:59 [DEBUG   ] Got command RPT from MCS: ref #15904
2013-08-12 16:54:59 [DEBUG   ] summary = NORMAL
2013-08-12 16:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15904  14 56516 60899439 A NORMALNORMAL'
2013-08-12 16:54:59 [DEBUG   ] Got command RPT from MCS: ref #15905
2013-08-12 16:54:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 16:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15905  48 56516 60899439 A NORMALSystem calibrated and operating normally'
2013-08-12 16:55:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 16:55:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 16:55:50 [DEBUG   ] Finished updating board flags in 1.812 seconds
2013-08-12 16:55:51 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2013-08-12 16:56:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 16:56:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 16:56:50 [DEBUG   ] Finished updating board flags in 1.727 seconds
2013-08-12 16:56:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 16:57:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 16:57:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 16:57:50 [DEBUG   ] Finished updating board flags in 1.643 seconds
2013-08-12 16:57:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 16:58:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 16:58:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 16:58:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-12 16:58:50 [DEBUG   ] Finished updating board flags in 1.656 seconds
2013-08-12 16:58:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 16:59:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 16:59:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 16:59:50 [DEBUG   ] Finished updating board flags in 1.510 seconds
2013-08-12 16:59:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 16:59:59 [DEBUG   ] Got command RPT from MCS: ref #15921
2013-08-12 16:59:59 [DEBUG   ] summary = NORMAL
2013-08-12 16:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15921  14 56516 61199439 A NORMALNORMAL'
2013-08-12 16:59:59 [DEBUG   ] Got command RPT from MCS: ref #15922
2013-08-12 16:59:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 16:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15922  48 56516 61199439 A NORMALSystem calibrated and operating normally'
2013-08-12 17:00:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 17:00:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 17:00:50 [DEBUG   ] Finished updating board flags in 1.557 seconds
2013-08-12 17:00:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 17:01:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 17:01:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 17:01:51 [DEBUG   ] Finished updating board flags in 1.577 seconds
2013-08-12 17:01:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 17:02:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 17:02:31 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-08-12 17:02:51 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2013-08-12 17:02:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-12 17:02:51 [DEBUG   ] Finished updating board flags in 2.123 seconds
2013-08-12 17:03:11 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2013-08-12 17:03:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-12 17:03:51 [DEBUG   ] Finished updating board flags in 2.020 seconds
2013-08-12 17:03:52 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-08-12 17:04:12 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-12 17:04:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 17:04:51 [DEBUG   ] Finished updating board flags in 1.939 seconds
2013-08-12 17:04:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 17:04:59 [DEBUG   ] Got command RPT from MCS: ref #15938
2013-08-12 17:04:59 [DEBUG   ] summary = NORMAL
2013-08-12 17:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15938  14 56516 61499447 A NORMALNORMAL'
2013-08-12 17:04:59 [DEBUG   ] Got command RPT from MCS: ref #15939
2013-08-12 17:04:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 17:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15939  48 56516 61499447 A NORMALSystem calibrated and operating normally'
2013-08-12 17:05:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 17:05:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 17:05:51 [DEBUG   ] Finished updating board flags in 1.892 seconds
2013-08-12 17:05:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 17:06:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 17:06:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 17:06:51 [DEBUG   ] Finished updating board flags in 1.738 seconds
2013-08-12 17:06:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 17:07:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 17:07:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 17:07:51 [DEBUG   ] Finished updating board flags in 1.619 seconds
2013-08-12 17:07:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 17:08:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 17:08:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 17:08:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-12 17:08:51 [DEBUG   ] Finished updating board flags in 1.624 seconds
2013-08-12 17:08:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 17:09:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 17:09:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 17:09:51 [DEBUG   ] Finished updating board flags in 1.554 seconds
2013-08-12 17:09:52 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2013-08-12 17:09:59 [DEBUG   ] Got command RPT from MCS: ref #15955
2013-08-12 17:09:59 [DEBUG   ] summary = NORMAL
2013-08-12 17:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15955  14 56516 61799447 A NORMALNORMAL'
2013-08-12 17:09:59 [DEBUG   ] Got command RPT from MCS: ref #15956
2013-08-12 17:09:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 17:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15956  48 56516 61799447 A NORMALSystem calibrated and operating normally'
2013-08-12 17:10:12 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-08-12 17:10:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 17:10:51 [DEBUG   ] Finished updating board flags in 1.506 seconds
2013-08-12 17:10:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 17:11:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 17:11:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 17:11:51 [DEBUG   ] Finished updating board flags in 1.566 seconds
2013-08-12 17:11:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 17:12:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 17:12:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 17:12:52 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2013-08-12 17:12:52 [DEBUG   ] Finished updating board flags in 2.197 seconds
2013-08-12 17:13:12 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2013-08-12 17:13:33 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-08-12 17:13:52 [DEBUG   ] Finished updating board flags in 1.923 seconds
2013-08-12 17:13:53 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-12 17:14:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 17:14:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 17:14:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 17:14:53 [DEBUG   ] Finished updating board flags in 2.936 seconds
2013-08-12 17:14:59 [DEBUG   ] Got command RPT from MCS: ref #15972
2013-08-12 17:14:59 [DEBUG   ] summary = NORMAL
2013-08-12 17:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15972  14 56516 62099451 A NORMALNORMAL'
2013-08-12 17:14:59 [DEBUG   ] Got command RPT from MCS: ref #15973
2013-08-12 17:14:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 17:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15973  48 56516 62099451 A NORMALSystem calibrated and operating normally'
2013-08-12 17:15:13 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2013-08-12 17:15:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 17:15:52 [DEBUG   ] Finished updating board flags in 1.680 seconds
2013-08-12 17:15:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 17:16:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 17:16:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 17:16:52 [DEBUG   ] Finished updating board flags in 1.628 seconds
2013-08-12 17:16:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 17:17:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 17:17:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 17:17:52 [DEBUG   ] Finished updating board flags in 1.630 seconds
2013-08-12 17:17:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 17:18:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 17:18:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 17:18:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-12 17:18:52 [DEBUG   ] Finished updating board flags in 1.568 seconds
2013-08-12 17:18:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 17:19:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 17:19:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 17:19:52 [DEBUG   ] Finished updating board flags in 1.558 seconds
2013-08-12 17:19:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 17:19:59 [DEBUG   ] Got command RPT from MCS: ref #15989
2013-08-12 17:19:59 [DEBUG   ] summary = NORMAL
2013-08-12 17:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15989  14 56516 62399443 A NORMALNORMAL'
2013-08-12 17:19:59 [DEBUG   ] Got command RPT from MCS: ref #15990
2013-08-12 17:19:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 17:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    15990  48 56516 62399443 A NORMALSystem calibrated and operating normally'
2013-08-12 17:20:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 17:20:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 17:20:53 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2013-08-12 17:20:53 [DEBUG   ] Finished updating board flags in 2.281 seconds
2013-08-12 17:21:13 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2013-08-12 17:21:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 17:21:53 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2013-08-12 17:21:53 [DEBUG   ] Finished updating board flags in 2.153 seconds
2013-08-12 17:22:13 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2013-08-12 17:22:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 17:22:53 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2013-08-12 17:22:53 [DEBUG   ] Finished updating board flags in 2.034 seconds
2013-08-12 17:23:13 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2013-08-12 17:23:34 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-08-12 17:23:53 [DEBUG   ] Finished updating board flags in 1.947 seconds
2013-08-12 17:23:54 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-08-12 17:24:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 17:24:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 17:24:53 [DEBUG   ] Finished updating board flags in 1.866 seconds
2013-08-12 17:24:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 17:24:59 [DEBUG   ] Got command RPT from MCS: ref #16006
2013-08-12 17:24:59 [DEBUG   ] summary = NORMAL
2013-08-12 17:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16006  14 56516 62699443 A NORMALNORMAL'
2013-08-12 17:24:59 [DEBUG   ] Got command RPT from MCS: ref #16007
2013-08-12 17:24:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 17:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16007  48 56516 62699443 A NORMALSystem calibrated and operating normally'
2013-08-12 17:25:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 17:25:34 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 17:25:53 [DEBUG   ] Finished updating board flags in 1.839 seconds
2013-08-12 17:25:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 17:26:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 17:26:34 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 17:26:53 [DEBUG   ] Finished updating board flags in 1.702 seconds
2013-08-12 17:26:54 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 17:27:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 17:27:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 17:27:53 [DEBUG   ] Finished updating board flags in 1.639 seconds
2013-08-12 17:27:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 17:28:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 17:28:34 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2013-08-12 17:28:53 [DEBUG   ] Finished updating board flags in 1.581 seconds
2013-08-12 17:28:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 17:29:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 17:29:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 17:29:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-12 17:29:53 [DEBUG   ] Finished updating board flags in 1.500 seconds
2013-08-12 17:29:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 17:29:59 [DEBUG   ] Got command RPT from MCS: ref #16023
2013-08-12 17:29:59 [DEBUG   ] summary = NORMAL
2013-08-12 17:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16023  14 56516 62999447 A NORMALNORMAL'
2013-08-12 17:29:59 [DEBUG   ] Got command RPT from MCS: ref #16024
2013-08-12 17:29:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 17:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16024  48 56516 62999447 A NORMALSystem calibrated and operating normally'
2013-08-12 17:30:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-12 17:30:34 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-12 17:30:53 [DEBUG   ] Finished updating board flags in 1.580 seconds
2013-08-12 17:30:54 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-08-12 17:31:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 17:31:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 17:31:54 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2013-08-12 17:31:54 [DEBUG   ] Finished updating board flags in 2.148 seconds
2013-08-12 17:32:14 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2013-08-12 17:32:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-08-12 17:32:54 [DEBUG   ] Finished updating board flags in 1.984 seconds
2013-08-12 17:32:55 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-08-12 17:33:15 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-08-12 17:33:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 17:33:54 [DEBUG   ] Finished updating board flags in 1.806 seconds
2013-08-12 17:33:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 17:34:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 17:34:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 17:34:54 [DEBUG   ] Finished updating board flags in 1.855 seconds
2013-08-12 17:34:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 17:34:59 [DEBUG   ] Got command RPT from MCS: ref #16040
2013-08-12 17:34:59 [DEBUG   ] summary = NORMAL
2013-08-12 17:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16040  14 56516 63299455 A NORMALNORMAL'
2013-08-12 17:34:59 [DEBUG   ] Got command RPT from MCS: ref #16041
2013-08-12 17:34:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 17:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16041  48 56516 63299455 A NORMALSystem calibrated and operating normally'
2013-08-12 17:35:15 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-12 17:35:35 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2013-08-12 17:35:54 [DEBUG   ] Finished updating board flags in 1.734 seconds
2013-08-12 17:35:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 17:36:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 17:36:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 17:36:54 [DEBUG   ] Finished updating board flags in 1.623 seconds
2013-08-12 17:36:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 17:37:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 17:37:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 17:37:54 [DEBUG   ] Finished updating board flags in 1.610 seconds
2013-08-12 17:37:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-12 17:38:15 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2013-08-12 17:38:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 17:38:54 [DEBUG   ] Finished updating board flags in 1.563 seconds
2013-08-12 17:38:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 17:39:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 17:39:35 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-08-12 17:39:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-12 17:39:54 [DEBUG   ] Finished updating board flags in 1.480 seconds
2013-08-12 17:39:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 17:39:59 [DEBUG   ] Got command RPT from MCS: ref #16057
2013-08-12 17:39:59 [DEBUG   ] summary = NORMAL
2013-08-12 17:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16057  14 56516 63599455 A NORMALNORMAL'
2013-08-12 17:39:59 [DEBUG   ] Got command RPT from MCS: ref #16058
2013-08-12 17:39:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 17:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16058  48 56516 63599455 A NORMALSystem calibrated and operating normally'
2013-08-12 17:40:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 17:40:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 17:40:54 [DEBUG   ] Finished updating board flags in 1.483 seconds
2013-08-12 17:40:55 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2013-08-12 17:41:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 17:41:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 17:41:54 [DEBUG   ] Finished updating board flags in 1.482 seconds
2013-08-12 17:41:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 17:42:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 17:42:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-12 17:42:55 [DEBUG   ] Finished updating board flags in 2.215 seconds
2013-08-12 17:42:56 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-12 17:43:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 17:43:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 17:43:55 [DEBUG   ] Finished updating board flags in 2.225 seconds
2013-08-12 17:43:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 17:44:16 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-08-12 17:44:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-08-12 17:44:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-12 17:44:55 [DEBUG   ] Finished updating board flags in 2.101 seconds
2013-08-12 17:44:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-12 17:44:59 [DEBUG   ] Got command RPT from MCS: ref #16074
2013-08-12 17:44:59 [DEBUG   ] summary = NORMAL
2013-08-12 17:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16074  14 56516 63899459 A NORMALNORMAL'
2013-08-12 17:44:59 [DEBUG   ] Got command RPT from MCS: ref #16075
2013-08-12 17:44:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 17:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16075  48 56516 63899459 A NORMALSystem calibrated and operating normally'
2013-08-12 17:45:16 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-12 17:45:36 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2013-08-12 17:45:55 [DEBUG   ] Finished updating board flags in 2.023 seconds
2013-08-12 17:45:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 17:46:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 17:46:37 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 17:46:55 [DEBUG   ] Finished updating board flags in 1.973 seconds
2013-08-12 17:46:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 17:47:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 17:47:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-12 17:47:55 [DEBUG   ] Finished updating board flags in 1.812 seconds
2013-08-12 17:47:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 17:48:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 17:48:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 17:48:55 [DEBUG   ] Finished updating board flags in 1.784 seconds
2013-08-12 17:48:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-12 17:49:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-12 17:49:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 17:49:55 [DEBUG   ] Finished updating board flags in 1.619 seconds
2013-08-12 17:49:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 17:49:59 [DEBUG   ] Got command RPT from MCS: ref #16091
2013-08-12 17:49:59 [DEBUG   ] summary = NORMAL
2013-08-12 17:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16091  14 56516 64199459 A NORMALNORMAL'
2013-08-12 17:49:59 [DEBUG   ] Got command RPT from MCS: ref #16092
2013-08-12 17:49:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 17:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16092  48 56516 64199459 A NORMALSystem calibrated and operating normally'
2013-08-12 17:50:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-12 17:50:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 17:50:55 [DEBUG   ] Finished updating board flags in 1.588 seconds
2013-08-12 17:50:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 17:51:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 17:51:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 17:51:55 [DEBUG   ] Finished updating board flags in 1.435 seconds
2013-08-12 17:51:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 17:52:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 17:52:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 17:52:55 [DEBUG   ] Finished updating board flags in 1.452 seconds
2013-08-12 17:52:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 17:53:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 17:53:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 17:53:55 [DEBUG   ] Finished updating board flags in 1.580 seconds
2013-08-12 17:53:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-12 17:54:17 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-08-12 17:54:38 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2013-08-12 17:54:56 [DEBUG   ] Finished updating board flags in 2.251 seconds
2013-08-12 17:54:58 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-08-12 17:54:59 [DEBUG   ] Got command RPT from MCS: ref #16108
2013-08-12 17:54:59 [DEBUG   ] summary = NORMAL
2013-08-12 17:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16108  14 56516 64499459 A NORMALNORMAL'
2013-08-12 17:54:59 [DEBUG   ] Got command RPT from MCS: ref #16109
2013-08-12 17:54:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 17:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16109  48 56516 64499459 A NORMALSystem calibrated and operating normally'
2013-08-12 17:55:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 17:55:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 17:55:56 [DEBUG   ] Finished updating board flags in 2.223 seconds
2013-08-12 17:55:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 17:56:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 17:56:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 17:56:56 [DEBUG   ] Finished updating board flags in 2.088 seconds
2013-08-12 17:56:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 17:57:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 17:57:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 17:57:56 [DEBUG   ] Finished updating board flags in 2.013 seconds
2013-08-12 17:57:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 17:58:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 17:58:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 17:58:56 [DEBUG   ] Finished updating board flags in 1.986 seconds
2013-08-12 17:58:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 17:59:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 17:59:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 17:59:56 [DEBUG   ] Finished updating board flags in 1.802 seconds
2013-08-12 17:59:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 17:59:59 [DEBUG   ] Got command RPT from MCS: ref #16125
2013-08-12 17:59:59 [DEBUG   ] summary = NORMAL
2013-08-12 17:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16125  14 56516 64799463 A NORMALNORMAL'
2013-08-12 17:59:59 [DEBUG   ] Got command RPT from MCS: ref #16126
2013-08-12 17:59:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 17:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16126  48 56516 64799463 A NORMALSystem calibrated and operating normally'
2013-08-12 18:00:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 18:00:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 18:00:56 [DEBUG   ] Finished updating board flags in 1.907 seconds
2013-08-12 18:00:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 18:01:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 18:01:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 18:01:56 [DEBUG   ] Finished updating board flags in 1.696 seconds
2013-08-12 18:01:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 18:02:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 18:02:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 18:02:56 [DEBUG   ] Finished updating board flags in 1.621 seconds
2013-08-12 18:02:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 18:03:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 18:03:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 18:03:56 [DEBUG   ] Finished updating board flags in 1.574 seconds
2013-08-12 18:03:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 18:04:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 18:04:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 18:04:56 [DEBUG   ] Finished updating board flags in 1.431 seconds
2013-08-12 18:04:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 18:04:59 [DEBUG   ] Got command RPT from MCS: ref #16142
2013-08-12 18:04:59 [DEBUG   ] summary = NORMAL
2013-08-12 18:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16142  14 56516 65099463 A NORMALNORMAL'
2013-08-12 18:04:59 [DEBUG   ] Got command RPT from MCS: ref #16143
2013-08-12 18:04:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 18:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16143  48 56516 65099463 A NORMALSystem calibrated and operating normally'
2013-08-12 18:05:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 18:05:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 18:05:56 [DEBUG   ] Finished updating board flags in 1.553 seconds
2013-08-12 18:05:58 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 18:06:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 18:06:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 18:06:57 [DEBUG   ] Finished updating board flags in 1.582 seconds
2013-08-12 18:06:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 18:07:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 18:07:38 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 18:07:57 [DEBUG   ] Finished updating board flags in 2.132 seconds
2013-08-12 18:07:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 18:08:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 18:08:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 18:08:57 [DEBUG   ] Finished updating board flags in 2.028 seconds
2013-08-12 18:08:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 18:09:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 18:09:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 18:09:57 [DEBUG   ] Finished updating board flags in 2.019 seconds
2013-08-12 18:09:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 18:09:59 [DEBUG   ] Got command RPT from MCS: ref #16159
2013-08-12 18:09:59 [DEBUG   ] summary = NORMAL
2013-08-12 18:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16159  14 56516 65399459 A NORMALNORMAL'
2013-08-12 18:09:59 [DEBUG   ] Got command RPT from MCS: ref #16160
2013-08-12 18:09:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 18:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16160  48 56516 65399459 A NORMALSystem calibrated and operating normally'
2013-08-12 18:10:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 18:10:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 18:10:57 [DEBUG   ] Finished updating board flags in 1.912 seconds
2013-08-12 18:10:58 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-08-12 18:11:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 18:11:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 18:11:57 [DEBUG   ] Finished updating board flags in 1.818 seconds
2013-08-12 18:11:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 18:12:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 18:12:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 18:12:57 [DEBUG   ] Finished updating board flags in 1.773 seconds
2013-08-12 18:12:58 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-08-12 18:13:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 18:13:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 18:13:57 [DEBUG   ] Finished updating board flags in 1.608 seconds
2013-08-12 18:13:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 18:14:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 18:14:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 18:14:57 [DEBUG   ] Finished updating board flags in 1.626 seconds
2013-08-12 18:14:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 18:14:59 [DEBUG   ] Got command RPT from MCS: ref #16176
2013-08-12 18:14:59 [DEBUG   ] summary = NORMAL
2013-08-12 18:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16176  14 56516 65699455 A NORMALNORMAL'
2013-08-12 18:14:59 [DEBUG   ] Got command RPT from MCS: ref #16177
2013-08-12 18:14:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 18:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16177  48 56516 65699455 A NORMALSystem calibrated and operating normally'
2013-08-12 18:15:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 18:15:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 18:15:57 [DEBUG   ] Finished updating board flags in 1.648 seconds
2013-08-12 18:15:58 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2013-08-12 18:16:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-12 18:16:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-12 18:16:57 [DEBUG   ] Finished updating board flags in 1.490 seconds
2013-08-12 18:16:59 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-08-12 18:17:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 18:17:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 18:17:57 [DEBUG   ] Finished updating board flags in 1.454 seconds
2013-08-12 18:17:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 18:18:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 18:18:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 18:18:57 [DEBUG   ] Finished updating board flags in 1.459 seconds
2013-08-12 18:18:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 18:19:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 18:19:39 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 18:19:57 [DEBUG   ] Finished updating board flags in 1.496 seconds
2013-08-12 18:19:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 18:19:59 [DEBUG   ] Got command RPT from MCS: ref #16193
2013-08-12 18:19:59 [DEBUG   ] summary = NORMAL
2013-08-12 18:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16193  14 56516 65999459 A NORMALNORMAL'
2013-08-12 18:19:59 [DEBUG   ] Got command RPT from MCS: ref #16194
2013-08-12 18:19:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 18:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16194  48 56516 65999459 A NORMALSystem calibrated and operating normally'
2013-08-12 18:20:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 18:20:39 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2013-08-12 18:20:57 [DEBUG   ] Finished updating board flags in 1.498 seconds
2013-08-12 18:20:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 18:21:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 18:21:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 18:21:58 [DEBUG   ] Finished updating board flags in 2.167 seconds
2013-08-12 18:21:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 18:22:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 18:22:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 18:22:58 [DEBUG   ] Finished updating board flags in 2.060 seconds
2013-08-12 18:22:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-12 18:23:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 18:23:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 18:23:58 [DEBUG   ] Finished updating board flags in 1.947 seconds
2013-08-12 18:23:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 18:24:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-12 18:24:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 18:24:58 [DEBUG   ] Finished updating board flags in 1.762 seconds
2013-08-12 18:24:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 18:24:59 [DEBUG   ] Got command RPT from MCS: ref #16210
2013-08-12 18:24:59 [DEBUG   ] summary = NORMAL
2013-08-12 18:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16210  14 56516 66299463 A NORMALNORMAL'
2013-08-12 18:24:59 [DEBUG   ] Got command RPT from MCS: ref #16211
2013-08-12 18:24:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 18:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16211  48 56516 66299463 A NORMALSystem calibrated and operating normally'
2013-08-12 18:25:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 18:25:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 18:25:58 [DEBUG   ] Finished updating board flags in 1.588 seconds
2013-08-12 18:25:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 18:26:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 18:26:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 18:26:58 [DEBUG   ] Finished updating board flags in 1.408 seconds
2013-08-12 18:26:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-12 18:27:20 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-08-12 18:27:40 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-12 18:27:58 [DEBUG   ] Finished updating board flags in 1.390 seconds
2013-08-12 18:28:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 18:28:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 18:28:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 18:28:58 [DEBUG   ] Finished updating board flags in 1.375 seconds
2013-08-12 18:29:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 18:29:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 18:29:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 18:29:59 [DEBUG   ] Got command RPT from MCS: ref #16227
2013-08-12 18:29:59 [DEBUG   ] summary = NORMAL
2013-08-12 18:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16227  14 56516 66599463 A NORMALNORMAL'
2013-08-12 18:29:59 [DEBUG   ] Got command RPT from MCS: ref #16228
2013-08-12 18:29:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 18:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16228  48 56516 66599463 A NORMALSystem calibrated and operating normally'
2013-08-12 18:29:59 [DEBUG   ] Finished updating board flags in 2.085 seconds
2013-08-12 18:30:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 18:30:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 18:30:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 18:30:59 [DEBUG   ] Finished updating board flags in 2.023 seconds
2013-08-12 18:31:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 18:31:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 18:31:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 18:31:59 [DEBUG   ] Finished updating board flags in 2.025 seconds
2013-08-12 18:32:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 18:32:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 18:32:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 18:32:59 [DEBUG   ] Finished updating board flags in 2.024 seconds
2013-08-12 18:33:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 18:33:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 18:33:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 18:33:59 [DEBUG   ] Finished updating board flags in 2.014 seconds
2013-08-12 18:34:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 18:34:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 18:34:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 18:34:59 [DEBUG   ] Got command RPT from MCS: ref #16244
2013-08-12 18:34:59 [DEBUG   ] summary = NORMAL
2013-08-12 18:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16244  14 56516 66899463 A NORMALNORMAL'
2013-08-12 18:34:59 [DEBUG   ] Got command RPT from MCS: ref #16245
2013-08-12 18:34:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 18:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16245  48 56516 66899463 A NORMALSystem calibrated and operating normally'
2013-08-12 18:34:59 [DEBUG   ] Finished updating board flags in 1.904 seconds
2013-08-12 18:35:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 18:35:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-12 18:35:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 18:35:59 [DEBUG   ] Finished updating board flags in 1.813 seconds
2013-08-12 18:36:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 18:36:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 18:36:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 18:36:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-12 18:36:59 [DEBUG   ] Finished updating board flags in 1.796 seconds
2013-08-12 18:37:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 18:37:20 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 18:37:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 18:37:59 [DEBUG   ] Finished updating board flags in 1.669 seconds
2013-08-12 18:38:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 18:38:20 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2013-08-12 18:38:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 18:39:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 18:39:00 [DEBUG   ] Finished updating board flags in 2.309 seconds
2013-08-12 18:39:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 18:39:40 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2013-08-12 18:39:59 [DEBUG   ] Got command RPT from MCS: ref #16261
2013-08-12 18:39:59 [DEBUG   ] summary = NORMAL
2013-08-12 18:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16261  14 56516 67199468 A NORMALNORMAL'
2013-08-12 18:39:59 [DEBUG   ] Got command RPT from MCS: ref #16262
2013-08-12 18:39:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 18:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16262  48 56516 67199468 A NORMALSystem calibrated and operating normally'
2013-08-12 18:39:59 [DEBUG   ] Finished updating board flags in 1.574 seconds
2013-08-12 18:40:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 18:40:20 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 18:40:40 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-12 18:41:00 [DEBUG   ] Finished updating board flags in 1.582 seconds
2013-08-12 18:41:01 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-08-12 18:41:21 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 18:41:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 18:42:00 [DEBUG   ] Finished updating board flags in 2.093 seconds
2013-08-12 18:42:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 18:42:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 18:42:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 18:43:00 [DEBUG   ] Finished updating board flags in 2.048 seconds
2013-08-12 18:43:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 18:43:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 18:43:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 18:44:00 [DEBUG   ] Finished updating board flags in 2.051 seconds
2013-08-12 18:44:01 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 18:44:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 18:44:41 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2013-08-12 18:44:59 [DEBUG   ] Got command RPT from MCS: ref #16278
2013-08-12 18:44:59 [DEBUG   ] summary = NORMAL
2013-08-12 18:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16278  14 56516 67499468 A NORMALNORMAL'
2013-08-12 18:44:59 [DEBUG   ] Got command RPT from MCS: ref #16279
2013-08-12 18:44:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 18:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16279  48 56516 67499468 A NORMALSystem calibrated and operating normally'
2013-08-12 18:45:00 [DEBUG   ] Finished updating board flags in 1.865 seconds
2013-08-12 18:45:01 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 18:45:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-12 18:45:41 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-12 18:46:00 [DEBUG   ] Finished updating board flags in 1.799 seconds
2013-08-12 18:46:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 18:46:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 18:46:41 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 18:47:00 [DEBUG   ] Finished updating board flags in 1.604 seconds
2013-08-12 18:47:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-12 18:47:22 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-08-12 18:47:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 18:48:00 [DEBUG   ] Finished updating board flags in 1.586 seconds
2013-08-12 18:48:02 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2013-08-12 18:48:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 18:48:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 18:49:00 [DEBUG   ] Finished updating board flags in 1.419 seconds
2013-08-12 18:49:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 18:49:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 18:49:42 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-12 18:49:59 [DEBUG   ] Got command RPT from MCS: ref #16295
2013-08-12 18:49:59 [DEBUG   ] summary = NORMAL
2013-08-12 18:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16295  14 56516 67799463 A NORMALNORMAL'
2013-08-12 18:49:59 [DEBUG   ] Got command RPT from MCS: ref #16296
2013-08-12 18:49:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 18:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16296  48 56516 67799464 A NORMALSystem calibrated and operating normally'
2013-08-12 18:50:00 [DEBUG   ] Finished updating board flags in 1.387 seconds
2013-08-12 18:50:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 18:50:22 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2013-08-12 18:50:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 18:51:00 [DEBUG   ] Finished updating board flags in 1.360 seconds
2013-08-12 18:51:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 18:51:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 18:51:42 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-12 18:52:01 [DEBUG   ] Finished updating board flags in 2.047 seconds
2013-08-12 18:52:02 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-12 18:52:23 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-08-12 18:52:43 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-12 18:53:01 [DEBUG   ] Finished updating board flags in 2.015 seconds
2013-08-12 18:53:03 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-12 18:53:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 18:53:43 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 18:54:01 [DEBUG   ] Finished updating board flags in 1.933 seconds
2013-08-12 18:54:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-12 18:54:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 18:54:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 18:54:59 [DEBUG   ] Got command RPT from MCS: ref #16312
2013-08-12 18:54:59 [DEBUG   ] summary = NORMAL
2013-08-12 18:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16312  14 56516 68099463 A NORMALNORMAL'
2013-08-12 18:54:59 [DEBUG   ] Got command RPT from MCS: ref #16313
2013-08-12 18:54:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 18:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16313  48 56516 68099463 A NORMALSystem calibrated and operating normally'
2013-08-12 18:55:01 [DEBUG   ] Finished updating board flags in 1.811 seconds
2013-08-12 18:55:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-12 18:55:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 18:55:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 18:56:01 [DEBUG   ] Finished updating board flags in 1.782 seconds
2013-08-12 18:56:03 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-08-12 18:56:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-12 18:56:43 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-08-12 18:57:01 [DEBUG   ] Finished updating board flags in 1.621 seconds
2013-08-12 18:57:03 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-12 18:57:24 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-08-12 18:57:44 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-12 18:58:01 [DEBUG   ] Finished updating board flags in 1.602 seconds
2013-08-12 18:58:04 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-12 18:58:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 18:58:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-12 18:59:01 [DEBUG   ] Finished updating board flags in 1.582 seconds
2013-08-12 18:59:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 18:59:24 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-12 18:59:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 18:59:59 [DEBUG   ] Got command RPT from MCS: ref #16329
2013-08-12 18:59:59 [DEBUG   ] summary = NORMAL
2013-08-12 18:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16329  14 56516 68399463 A NORMALNORMAL'
2013-08-12 18:59:59 [DEBUG   ] Got command RPT from MCS: ref #16330
2013-08-12 18:59:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 18:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16330  48 56516 68399463 A NORMALSystem calibrated and operating normally'
2013-08-12 19:00:01 [DEBUG   ] Finished updating board flags in 1.410 seconds
2013-08-12 19:00:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 19:00:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 19:00:44 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-12 19:01:01 [DEBUG   ] Finished updating board flags in 1.393 seconds
2013-08-12 19:01:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 19:01:25 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-08-12 19:01:45 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-08-12 19:02:01 [DEBUG   ] Finished updating board flags in 1.355 seconds
2013-08-12 19:02:05 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2013-08-12 19:02:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 19:02:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 19:03:02 [DEBUG   ] Finished updating board flags in 2.056 seconds
2013-08-12 19:03:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-12 19:03:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 19:03:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-12 19:04:02 [DEBUG   ] Finished updating board flags in 1.989 seconds
2013-08-12 19:04:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 19:04:25 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-12 19:04:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 19:04:59 [DEBUG   ] Got command RPT from MCS: ref #16346
2013-08-12 19:04:59 [DEBUG   ] summary = NORMAL
2013-08-12 19:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16346  14 56516 68699467 A NORMALNORMAL'
2013-08-12 19:04:59 [DEBUG   ] Got command RPT from MCS: ref #16347
2013-08-12 19:04:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 19:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16347  48 56516 68699467 A NORMALSystem calibrated and operating normally'
2013-08-12 19:05:02 [DEBUG   ] Finished updating board flags in 1.814 seconds
2013-08-12 19:05:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 19:05:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 19:05:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 19:06:02 [DEBUG   ] Finished updating board flags in 1.808 seconds
2013-08-12 19:06:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 19:06:26 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-08-12 19:06:46 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-08-12 19:07:02 [DEBUG   ] Finished updating board flags in 1.785 seconds
2013-08-12 19:07:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 19:07:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-08-12 19:07:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 19:08:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-12 19:08:02 [DEBUG   ] Finished updating board flags in 1.613 seconds
2013-08-12 19:08:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-12 19:08:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 19:08:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 19:09:02 [DEBUG   ] Finished updating board flags in 1.616 seconds
2013-08-12 19:09:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 19:09:26 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-12 19:09:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 19:09:59 [DEBUG   ] Got command RPT from MCS: ref #16363
2013-08-12 19:09:59 [DEBUG   ] summary = NORMAL
2013-08-12 19:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16363  14 56516 68999467 A NORMALNORMAL'
2013-08-12 19:09:59 [DEBUG   ] Got command RPT from MCS: ref #16364
2013-08-12 19:09:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 19:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16364  48 56516 68999467 A NORMALSystem calibrated and operating normally'
2013-08-12 19:10:02 [DEBUG   ] Finished updating board flags in 1.588 seconds
2013-08-12 19:10:06 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-08-12 19:10:26 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-12 19:10:47 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-08-12 19:11:02 [DEBUG   ] Finished updating board flags in 1.394 seconds
2013-08-12 19:11:07 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-12 19:11:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 19:11:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 19:12:02 [DEBUG   ] Finished updating board flags in 1.362 seconds
2013-08-12 19:12:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 19:12:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 19:12:47 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-12 19:13:03 [DEBUG   ] Finished updating board flags in 2.043 seconds
2013-08-12 19:13:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 19:13:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-12 19:13:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 19:14:03 [DEBUG   ] Finished updating board flags in 2.014 seconds
2013-08-12 19:14:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 19:14:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 19:14:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 19:14:59 [DEBUG   ] Got command RPT from MCS: ref #16380
2013-08-12 19:14:59 [DEBUG   ] summary = NORMAL
2013-08-12 19:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16380  14 56516 69299475 A NORMALNORMAL'
2013-08-12 19:14:59 [DEBUG   ] Got command RPT from MCS: ref #16381
2013-08-12 19:14:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 19:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16381  48 56516 69299475 A NORMALSystem calibrated and operating normally'
2013-08-12 19:15:03 [DEBUG   ] Finished updating board flags in 1.983 seconds
2013-08-12 19:15:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 19:15:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 19:15:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 19:16:03 [DEBUG   ] Finished updating board flags in 1.829 seconds
2013-08-12 19:16:07 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-08-12 19:16:27 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-12 19:16:48 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-08-12 19:17:03 [DEBUG   ] Finished updating board flags in 1.775 seconds
2013-08-12 19:17:08 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-12 19:17:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 19:17:48 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-12 19:18:03 [DEBUG   ] Finished updating board flags in 1.622 seconds
2013-08-12 19:18:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 19:18:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 19:18:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 19:19:03 [DEBUG   ] Finished updating board flags in 1.607 seconds
2013-08-12 19:19:08 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-12 19:19:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 19:19:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 19:19:59 [DEBUG   ] Got command RPT from MCS: ref #16397
2013-08-12 19:19:59 [DEBUG   ] summary = NORMAL
2013-08-12 19:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16397  14 56516 69599471 A NORMALNORMAL'
2013-08-12 19:19:59 [DEBUG   ] Got command RPT from MCS: ref #16398
2013-08-12 19:19:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 19:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16398  48 56516 69599471 A NORMALSystem calibrated and operating normally'
2013-08-12 19:20:03 [DEBUG   ] Finished updating board flags in 1.583 seconds
2013-08-12 19:20:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 19:20:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 19:20:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-12 19:21:03 [DEBUG   ] Finished updating board flags in 1.441 seconds
2013-08-12 19:21:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 19:21:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 19:21:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 19:22:03 [DEBUG   ] Finished updating board flags in 1.403 seconds
2013-08-12 19:22:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-12 19:22:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-08-12 19:22:49 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-08-12 19:23:03 [DEBUG   ] Finished updating board flags in 1.362 seconds
2013-08-12 19:23:09 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-08-12 19:23:29 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-08-12 19:23:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 19:24:03 [DEBUG   ] Finished updating board flags in 1.355 seconds
2013-08-12 19:24:09 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-12 19:24:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 19:24:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 19:24:59 [DEBUG   ] Got command RPT from MCS: ref #16414
2013-08-12 19:24:59 [DEBUG   ] summary = NORMAL
2013-08-12 19:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16414  14 56516 69899475 A NORMALNORMAL'
2013-08-12 19:24:59 [DEBUG   ] Got command RPT from MCS: ref #16415
2013-08-12 19:24:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 19:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16415  48 56516 69899475 A NORMALSystem calibrated and operating normally'
2013-08-12 19:25:04 [DEBUG   ] Finished updating board flags in 2.069 seconds
2013-08-12 19:25:09 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-08-12 19:25:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 19:25:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 19:26:04 [DEBUG   ] Finished updating board flags in 1.982 seconds
2013-08-12 19:26:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 19:26:29 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-12 19:26:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 19:27:04 [DEBUG   ] Finished updating board flags in 1.819 seconds
2013-08-12 19:27:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-12 19:27:30 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-08-12 19:27:50 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-08-12 19:28:04 [DEBUG   ] Finished updating board flags in 1.790 seconds
2013-08-12 19:28:10 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 19:28:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 19:28:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 19:29:04 [DEBUG   ] Finished updating board flags in 1.615 seconds
2013-08-12 19:29:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-12 19:29:30 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 19:29:50 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-12 19:29:59 [DEBUG   ] Got command RPT from MCS: ref #16431
2013-08-12 19:29:59 [DEBUG   ] summary = NORMAL
2013-08-12 19:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16431  14 56516 70199471 A NORMALNORMAL'
2013-08-12 19:29:59 [DEBUG   ] Got command RPT from MCS: ref #16432
2013-08-12 19:29:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 19:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16432  48 56516 70199471 A NORMALSystem calibrated and operating normally'
2013-08-12 19:30:04 [DEBUG   ] Finished updating board flags in 1.585 seconds
2013-08-12 19:30:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 19:30:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 19:30:50 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 19:31:04 [DEBUG   ] Finished updating board flags in 1.413 seconds
2013-08-12 19:31:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-12 19:31:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-08-12 19:31:51 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-08-12 19:32:04 [DEBUG   ] Finished updating board flags in 1.389 seconds
2013-08-12 19:32:11 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-08-12 19:32:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 19:32:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 19:33:04 [DEBUG   ] Finished updating board flags in 1.354 seconds
2013-08-12 19:33:11 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-08-12 19:33:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 19:33:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-12 19:34:05 [DEBUG   ] Finished updating board flags in 2.059 seconds
2013-08-12 19:34:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-12 19:34:31 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-08-12 19:34:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 19:34:59 [DEBUG   ] Got command RPT from MCS: ref #16448
2013-08-12 19:34:59 [DEBUG   ] summary = NORMAL
2013-08-12 19:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16448  14 56516 70499475 A NORMALNORMAL'
2013-08-12 19:34:59 [DEBUG   ] Got command RPT from MCS: ref #16449
2013-08-12 19:34:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 19:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16449  48 56516 70499475 A NORMALSystem calibrated and operating normally'
2013-08-12 19:35:05 [DEBUG   ] Finished updating board flags in 2.016 seconds
2013-08-12 19:35:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 19:35:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 19:35:51 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-08-12 19:36:05 [DEBUG   ] Finished updating board flags in 1.981 seconds
2013-08-12 19:36:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 19:36:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 19:36:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 19:37:05 [DEBUG   ] Finished updating board flags in 1.821 seconds
2013-08-12 19:37:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 19:37:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 19:37:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 19:38:05 [DEBUG   ] Finished updating board flags in 1.845 seconds
2013-08-12 19:38:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 19:38:31 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2013-08-12 19:38:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-08-12 19:39:05 [DEBUG   ] Finished updating board flags in 1.800 seconds
2013-08-12 19:39:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-12 19:39:31 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-08-12 19:39:51 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2013-08-12 19:39:59 [DEBUG   ] Got command RPT from MCS: ref #16465
2013-08-12 19:39:59 [DEBUG   ] summary = NORMAL
2013-08-12 19:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16465  14 56516 70799471 A NORMALNORMAL'
2013-08-12 19:39:59 [DEBUG   ] Got command RPT from MCS: ref #16466
2013-08-12 19:39:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 19:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16466  48 56516 70799471 A NORMALSystem calibrated and operating normally'
2013-08-12 19:40:05 [DEBUG   ] Finished updating board flags in 1.539 seconds
2013-08-12 19:40:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 19:40:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 19:40:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 19:41:05 [DEBUG   ] Finished updating board flags in 1.397 seconds
2013-08-12 19:41:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 19:41:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 19:41:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 19:42:06 [DEBUG   ] Finished updating board flags in 2.225 seconds
2013-08-12 19:42:12 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2013-08-12 19:42:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 19:42:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 19:43:06 [DEBUG   ] Finished updating board flags in 2.175 seconds
2013-08-12 19:43:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 19:43:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 19:43:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 19:44:06 [DEBUG   ] Finished updating board flags in 2.032 seconds
2013-08-12 19:44:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-12 19:44:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 19:44:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 19:44:59 [DEBUG   ] Got command RPT from MCS: ref #16482
2013-08-12 19:44:59 [DEBUG   ] summary = NORMAL
2013-08-12 19:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16482  14 56516 71099471 A NORMALNORMAL'
2013-08-12 19:44:59 [DEBUG   ] Got command RPT from MCS: ref #16483
2013-08-12 19:44:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 19:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16483  48 56516 71099471 A NORMALSystem calibrated and operating normally'
2013-08-12 19:45:06 [DEBUG   ] Finished updating board flags in 1.966 seconds
2013-08-12 19:45:12 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-08-12 19:45:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 19:45:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 19:46:06 [DEBUG   ] Finished updating board flags in 1.812 seconds
2013-08-12 19:46:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 19:46:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 19:46:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 19:47:06 [DEBUG   ] Finished updating board flags in 1.847 seconds
2013-08-12 19:47:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 19:47:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 19:47:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 19:48:06 [DEBUG   ] Finished updating board flags in 1.756 seconds
2013-08-12 19:48:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 19:48:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 19:48:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 19:49:06 [DEBUG   ] Finished updating board flags in 1.631 seconds
2013-08-12 19:49:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 19:49:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 19:49:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 19:49:59 [DEBUG   ] Got command RPT from MCS: ref #16499
2013-08-12 19:49:59 [DEBUG   ] summary = NORMAL
2013-08-12 19:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16499  14 56516 71399475 A NORMALNORMAL'
2013-08-12 19:49:59 [DEBUG   ] Got command RPT from MCS: ref #16500
2013-08-12 19:49:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 19:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16500  48 56516 71399475 A NORMALSystem calibrated and operating normally'
2013-08-12 19:50:06 [DEBUG   ] Finished updating board flags in 1.623 seconds
2013-08-12 19:50:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 19:50:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 19:50:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 19:51:06 [DEBUG   ] Finished updating board flags in 1.619 seconds
2013-08-12 19:51:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 19:51:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 19:51:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 19:52:06 [DEBUG   ] Finished updating board flags in 1.547 seconds
2013-08-12 19:52:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 19:52:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 19:52:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 19:53:06 [DEBUG   ] Finished updating board flags in 1.538 seconds
2013-08-12 19:53:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 19:53:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 19:53:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 19:54:06 [DEBUG   ] Finished updating board flags in 1.552 seconds
2013-08-12 19:54:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 19:54:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 19:54:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 19:54:59 [DEBUG   ] Got command RPT from MCS: ref #16516
2013-08-12 19:54:59 [DEBUG   ] summary = NORMAL
2013-08-12 19:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16516  14 56516 71699479 A NORMALNORMAL'
2013-08-12 19:54:59 [DEBUG   ] Got command RPT from MCS: ref #16517
2013-08-12 19:54:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 19:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16517  48 56516 71699479 A NORMALSystem calibrated and operating normally'
2013-08-12 19:55:07 [DEBUG   ] Finished updating board flags in 2.178 seconds
2013-08-12 19:55:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 19:55:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 19:55:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 19:56:07 [DEBUG   ] Finished updating board flags in 2.010 seconds
2013-08-12 19:56:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 19:56:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 19:56:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 19:57:07 [DEBUG   ] Finished updating board flags in 2.023 seconds
2013-08-12 19:57:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 19:57:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 19:57:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 19:58:07 [DEBUG   ] Finished updating board flags in 1.895 seconds
2013-08-12 19:58:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 19:58:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 19:58:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 19:59:07 [DEBUG   ] Finished updating board flags in 1.830 seconds
2013-08-12 19:59:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 19:59:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 19:59:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 19:59:59 [DEBUG   ] Got command RPT from MCS: ref #16533
2013-08-12 19:59:59 [DEBUG   ] summary = NORMAL
2013-08-12 19:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16533  14 56516 71999479 A NORMALNORMAL'
2013-08-12 19:59:59 [DEBUG   ] Got command RPT from MCS: ref #16534
2013-08-12 19:59:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 19:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16534  48 56516 71999479 A NORMALSystem calibrated and operating normally'
2013-08-12 20:00:07 [DEBUG   ] Finished updating board flags in 1.812 seconds
2013-08-12 20:00:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 20:00:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 20:00:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 20:01:07 [DEBUG   ] Finished updating board flags in 1.774 seconds
2013-08-12 20:01:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 20:01:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 20:01:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 20:02:07 [DEBUG   ] Finished updating board flags in 1.673 seconds
2013-08-12 20:02:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 20:02:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 20:02:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 20:03:07 [DEBUG   ] Finished updating board flags in 1.608 seconds
2013-08-12 20:03:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 20:03:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 20:03:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 20:04:07 [DEBUG   ] Finished updating board flags in 1.544 seconds
2013-08-12 20:04:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 20:04:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 20:04:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 20:04:59 [DEBUG   ] Got command RPT from MCS: ref #16550
2013-08-12 20:04:59 [DEBUG   ] summary = NORMAL
2013-08-12 20:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16550  14 56516 72299479 A NORMALNORMAL'
2013-08-12 20:04:59 [DEBUG   ] Got command RPT from MCS: ref #16551
2013-08-12 20:04:59 [DEBUG   ] info = System calibrated and operating normally
2013-08-12 20:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16551  48 56516 72299479 A NORMALSystem calibrated and operating normally'
2013-08-12 20:05:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-08-12 20:05:07 [CRITICAL] MGT underflow detected on beam(s) 1
2013-08-12 20:05:07 [DEBUG   ] Finished updating board flags in 1.501 seconds
2013-08-12 20:05:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 20:05:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 20:05:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 20:06:07 [DEBUG   ] Finished updating board flags in 1.534 seconds
2013-08-12 20:06:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 20:06:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 20:06:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 20:07:08 [DEBUG   ] Finished updating board flags in 2.208 seconds
2013-08-12 20:07:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 20:07:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 20:07:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 20:08:08 [DEBUG   ] Finished updating board flags in 2.264 seconds
2013-08-12 20:08:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 20:08:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 20:08:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 20:09:08 [DEBUG   ] Finished updating board flags in 2.101 seconds
2013-08-12 20:09:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 20:09:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 20:09:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 20:09:59 [DEBUG   ] Got command RPT from MCS: ref #16567
2013-08-12 20:09:59 [DEBUG   ] summary = ERROR
2013-08-12 20:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16567  13 56516 72599479 A  ERRORERROR'
2013-08-12 20:09:59 [DEBUG   ] Got command RPT from MCS: ref #16568
2013-08-12 20:09:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 20:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16568  77 56516 72599479 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 20:10:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-12 20:10:08 [DEBUG   ] Finished updating board flags in 1.986 seconds
2013-08-12 20:10:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 20:10:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 20:10:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 20:11:08 [DEBUG   ] Finished updating board flags in 1.799 seconds
2013-08-12 20:11:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 20:11:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 20:11:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 20:12:08 [DEBUG   ] Finished updating board flags in 1.617 seconds
2013-08-12 20:12:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 20:12:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 20:12:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 20:13:08 [DEBUG   ] Finished updating board flags in 1.590 seconds
2013-08-12 20:13:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 20:13:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 20:13:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 20:14:08 [DEBUG   ] Finished updating board flags in 1.519 seconds
2013-08-12 20:14:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 20:14:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 20:14:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 20:14:59 [DEBUG   ] Got command RPT from MCS: ref #16584
2013-08-12 20:14:59 [DEBUG   ] summary = ERROR
2013-08-12 20:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16584  13 56516 72899483 A  ERRORERROR'
2013-08-12 20:14:59 [DEBUG   ] Got command RPT from MCS: ref #16585
2013-08-12 20:14:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 20:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16585  77 56516 72899483 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 20:15:08 [DEBUG   ] Finished updating board flags in 1.570 seconds
2013-08-12 20:15:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 20:15:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 20:15:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 20:16:09 [DEBUG   ] Finished updating board flags in 2.227 seconds
2013-08-12 20:16:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 20:16:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 20:16:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 20:17:09 [DEBUG   ] Finished updating board flags in 2.082 seconds
2013-08-12 20:17:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 20:17:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 20:17:52 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2013-08-12 20:18:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-12 20:18:09 [DEBUG   ] Finished updating board flags in 2.019 seconds
2013-08-12 20:18:13 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-08-12 20:18:33 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-12 20:18:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:19:09 [DEBUG   ] Finished updating board flags in 2.022 seconds
2013-08-12 20:19:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:19:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:19:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 20:19:59 [DEBUG   ] Got command RPT from MCS: ref #16601
2013-08-12 20:19:59 [DEBUG   ] summary = ERROR
2013-08-12 20:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16601  13 56516 73199487 A  ERRORERROR'
2013-08-12 20:19:59 [DEBUG   ] Got command RPT from MCS: ref #16602
2013-08-12 20:19:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 20:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16602  77 56516 73199487 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 20:20:09 [DEBUG   ] Finished updating board flags in 1.978 seconds
2013-08-12 20:20:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 20:20:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:20:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:21:09 [DEBUG   ] Finished updating board flags in 1.813 seconds
2013-08-12 20:21:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 20:21:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 20:21:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:22:09 [DEBUG   ] Finished updating board flags in 1.804 seconds
2013-08-12 20:22:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 20:22:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 20:22:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:23:09 [DEBUG   ] Finished updating board flags in 1.887 seconds
2013-08-12 20:23:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 20:23:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:23:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 20:24:09 [DEBUG   ] Finished updating board flags in 1.720 seconds
2013-08-12 20:24:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 20:24:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:24:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 20:24:59 [DEBUG   ] Got command RPT from MCS: ref #16618
2013-08-12 20:24:59 [DEBUG   ] summary = ERROR
2013-08-12 20:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16618  13 56516 73499479 A  ERRORERROR'
2013-08-12 20:24:59 [DEBUG   ] Got command RPT from MCS: ref #16619
2013-08-12 20:24:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 20:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16619  77 56516 73499479 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 20:25:09 [DEBUG   ] Finished updating board flags in 1.584 seconds
2013-08-12 20:25:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 20:25:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 20:25:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:26:09 [DEBUG   ] Finished updating board flags in 1.389 seconds
2013-08-12 20:26:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 20:26:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 20:26:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 20:27:09 [DEBUG   ] Finished updating board flags in 1.387 seconds
2013-08-12 20:27:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:27:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 20:27:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 20:28:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-12 20:28:10 [DEBUG   ] Finished updating board flags in 2.107 seconds
2013-08-12 20:28:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 20:28:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:28:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:29:10 [DEBUG   ] Finished updating board flags in 1.953 seconds
2013-08-12 20:29:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 20:29:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 20:29:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 20:29:59 [DEBUG   ] Got command RPT from MCS: ref #16635
2013-08-12 20:29:59 [DEBUG   ] summary = ERROR
2013-08-12 20:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16635  13 56516 73799483 A  ERRORERROR'
2013-08-12 20:29:59 [DEBUG   ] Got command RPT from MCS: ref #16636
2013-08-12 20:29:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 20:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16636  77 56516 73799483 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 20:30:10 [DEBUG   ] Finished updating board flags in 1.777 seconds
2013-08-12 20:30:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 20:30:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 20:30:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 20:31:10 [DEBUG   ] Finished updating board flags in 1.619 seconds
2013-08-12 20:31:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:31:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:31:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 20:32:10 [DEBUG   ] Finished updating board flags in 1.566 seconds
2013-08-12 20:32:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:32:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 20:32:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 20:33:10 [DEBUG   ] Finished updating board flags in 1.490 seconds
2013-08-12 20:33:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 20:33:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 20:33:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:34:10 [DEBUG   ] Finished updating board flags in 1.511 seconds
2013-08-12 20:34:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:34:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 20:34:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 20:34:59 [DEBUG   ] Got command RPT from MCS: ref #16652
2013-08-12 20:34:59 [DEBUG   ] summary = ERROR
2013-08-12 20:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16652  13 56516 74099483 A  ERRORERROR'
2013-08-12 20:34:59 [DEBUG   ] Got command RPT from MCS: ref #16653
2013-08-12 20:34:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 20:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16653  77 56516 74099483 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 20:35:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-12 20:35:11 [DEBUG   ] Finished updating board flags in 1.578 seconds
2013-08-12 20:35:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:35:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:35:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 20:36:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-12 20:36:11 [DEBUG   ] Finished updating board flags in 2.166 seconds
2013-08-12 20:36:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:36:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:36:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:37:11 [DEBUG   ] Finished updating board flags in 1.880 seconds
2013-08-12 20:37:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 20:37:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 20:37:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:38:11 [DEBUG   ] Finished updating board flags in 1.801 seconds
2013-08-12 20:38:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:38:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 20:38:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 20:39:11 [DEBUG   ] Finished updating board flags in 1.818 seconds
2013-08-12 20:39:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:39:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 20:39:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 20:39:59 [DEBUG   ] Got command RPT from MCS: ref #16669
2013-08-12 20:39:59 [DEBUG   ] summary = ERROR
2013-08-12 20:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16669  13 56516 74399491 A  ERRORERROR'
2013-08-12 20:39:59 [DEBUG   ] Got command RPT from MCS: ref #16670
2013-08-12 20:39:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 20:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16670  77 56516 74399491 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 20:40:11 [DEBUG   ] Finished updating board flags in 1.780 seconds
2013-08-12 20:40:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 20:40:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:40:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:41:11 [DEBUG   ] Finished updating board flags in 1.717 seconds
2013-08-12 20:41:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 20:41:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 20:41:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:42:11 [DEBUG   ] Finished updating board flags in 1.498 seconds
2013-08-12 20:42:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 20:42:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 20:42:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 20:43:11 [DEBUG   ] Finished updating board flags in 1.501 seconds
2013-08-12 20:43:13 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2013-08-12 20:43:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 20:43:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 20:44:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-12 20:44:11 [DEBUG   ] Finished updating board flags in 1.510 seconds
2013-08-12 20:44:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 20:44:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 20:44:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 20:44:59 [DEBUG   ] Got command RPT from MCS: ref #16686
2013-08-12 20:44:59 [DEBUG   ] summary = ERROR
2013-08-12 20:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16686  13 56516 74699491 A  ERRORERROR'
2013-08-12 20:44:59 [DEBUG   ] Got command RPT from MCS: ref #16687
2013-08-12 20:44:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 20:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16687  77 56516 74699491 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-08-12 20:45:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-08-12 20:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-08-12 20:45:12 [DEBUG   ] Finished updating board flags in 2.275 seconds
2013-08-12 20:45:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 20:45:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 20:45:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-12 20:46:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999941
2013-08-12 20:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999941
2013-08-12 20:46:12 [DEBUG   ] Finished updating board flags in 2.158 seconds
2013-08-12 20:46:13 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 20:46:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 20:46:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 20:47:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-08-12 20:47:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-08-12 20:47:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-08-12 20:47:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-08-12 20:47:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-12 20:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-12 20:47:12 [DEBUG   ] Finished updating board flags in 2.070 seconds
2013-08-12 20:47:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 20:47:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 20:47:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-08-12 20:48:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-08-12 20:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-08-12 20:48:12 [DEBUG   ] Finished updating board flags in 1.957 seconds
2013-08-12 20:48:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 20:48:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 20:48:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-12 20:49:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999627
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999627
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999627
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999627
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-12 20:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-12 20:49:12 [DEBUG   ] Finished updating board flags in 1.870 seconds
2013-08-12 20:49:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-12 20:49:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 20:49:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 20:49:59 [DEBUG   ] Got command RPT from MCS: ref #16703
2013-08-12 20:49:59 [DEBUG   ] summary = ERROR
2013-08-12 20:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16703  13 56516 74999495 A  ERRORERROR'
2013-08-12 20:49:59 [DEBUG   ] Got command RPT from MCS: ref #16704
2013-08-12 20:49:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 20:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16704  77 56516 74999495 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000019
2013-08-12 20:50:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000019
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-08-12 20:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-08-12 20:50:12 [DEBUG   ] Finished updating board flags in 1.707 seconds
2013-08-12 20:50:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-12 20:50:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 20:50:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-12 20:51:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-12 20:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-12 20:51:12 [DEBUG   ] Finished updating board flags in 1.611 seconds
2013-08-12 20:51:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 20:51:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 20:51:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 20:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 20:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 20:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 20:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 20:52:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 20:52:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 20:52:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 20:52:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 20:52:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 20:52:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 20:52:12 [DEBUG   ] Finished updating board flags in 1.548 seconds
2013-08-12 20:52:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 20:52:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 20:52:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 20:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 20:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 20:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 20:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 20:53:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 20:53:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 20:53:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 20:53:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 20:53:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 20:53:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 20:53:12 [DEBUG   ] Finished updating board flags in 1.521 seconds
2013-08-12 20:53:13 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-08-12 20:53:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-08-12 20:53:53 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-08-12 20:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 20:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 20:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 20:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 20:54:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 20:54:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 20:54:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 20:54:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 20:54:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 20:54:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 20:54:12 [DEBUG   ] Finished updating board flags in 1.530 seconds
2013-08-12 20:54:14 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-08-12 20:54:34 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2013-08-12 20:54:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 20:54:59 [DEBUG   ] Got command RPT from MCS: ref #16720
2013-08-12 20:54:59 [DEBUG   ] summary = ERROR
2013-08-12 20:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16720  13 56516 75299491 A  ERRORERROR'
2013-08-12 20:54:59 [DEBUG   ] Got command RPT from MCS: ref #16721
2013-08-12 20:54:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 20:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16721  77 56516 75299491 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 20:55:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 20:55:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 20:55:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 20:55:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 20:55:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 20:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 20:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 20:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 20:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 20:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 20:55:14 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 20:55:14 [DEBUG   ] Finished updating board flags in 3.306 seconds
2013-08-12 20:55:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 20:55:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 20:56:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 20:56:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 20:56:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 20:56:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 20:56:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 20:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 20:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 20:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 20:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 20:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 20:56:13 [DEBUG   ] Finished updating board flags in 2.087 seconds
2013-08-12 20:56:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 20:56:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 20:56:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 20:57:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 20:57:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 20:57:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 20:57:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 20:57:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 20:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 20:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 20:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 20:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 20:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 20:57:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 20:57:14 [DEBUG   ] Finished updating board flags in 2.685 seconds
2013-08-12 20:57:34 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2013-08-12 20:57:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 20:58:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 20:58:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 20:58:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 20:58:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 20:58:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 20:58:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 20:58:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 20:58:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 20:58:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 20:58:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 20:58:13 [DEBUG   ] Finished updating board flags in 1.878 seconds
2013-08-12 20:58:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 20:58:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 20:58:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 20:59:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 20:59:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 20:59:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 20:59:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 20:59:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 20:59:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 20:59:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 20:59:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 20:59:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 20:59:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 20:59:13 [DEBUG   ] Finished updating board flags in 1.833 seconds
2013-08-12 20:59:15 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2013-08-12 20:59:34 [DEBUG   ] Finished updating ant stats in 0.407 seconds
2013-08-12 20:59:54 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-08-12 20:59:59 [DEBUG   ] Got command RPT from MCS: ref #16737
2013-08-12 20:59:59 [DEBUG   ] summary = ERROR
2013-08-12 20:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16737  13 56516 75599491 A  ERRORERROR'
2013-08-12 20:59:59 [DEBUG   ] Got command RPT from MCS: ref #16738
2013-08-12 20:59:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 20:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16738  77 56516 75599491 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 21:00:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:00:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:00:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:00:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:00:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:00:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:00:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:00:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:00:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:00:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:00:13 [DEBUG   ] Finished updating board flags in 1.773 seconds
2013-08-12 21:00:15 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-08-12 21:00:35 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-08-12 21:00:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 21:01:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:01:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:01:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:01:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:01:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:01:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:01:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:01:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:01:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:01:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:01:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-12 21:01:13 [DEBUG   ] Finished updating board flags in 1.616 seconds
2013-08-12 21:01:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 21:01:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 21:01:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 21:02:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:02:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:02:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:02:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:02:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:02:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:02:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:02:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:02:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:02:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:02:13 [DEBUG   ] Finished updating board flags in 1.603 seconds
2013-08-12 21:02:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 21:02:35 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-12 21:02:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 21:03:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:03:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:03:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:03:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:03:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:03:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:03:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:03:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:03:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:03:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:03:13 [DEBUG   ] Finished updating board flags in 1.590 seconds
2013-08-12 21:03:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 21:03:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 21:03:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 21:04:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:04:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:04:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:04:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:04:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:04:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:04:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:04:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:04:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:04:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:04:13 [DEBUG   ] Finished updating board flags in 1.439 seconds
2013-08-12 21:04:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 21:04:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 21:04:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 21:04:59 [DEBUG   ] Got command RPT from MCS: ref #16754
2013-08-12 21:04:59 [DEBUG   ] summary = ERROR
2013-08-12 21:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16754  13 56516 75899487 A  ERRORERROR'
2013-08-12 21:04:59 [DEBUG   ] Got command RPT from MCS: ref #16755
2013-08-12 21:04:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 21:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16755  77 56516 75899487 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 21:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:05:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:05:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:05:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:05:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:05:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:05:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:05:13 [DEBUG   ] Finished updating board flags in 1.471 seconds
2013-08-12 21:05:15 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 21:05:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 21:05:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 21:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:06:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:06:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:06:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:06:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:06:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:06:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:06:13 [DEBUG   ] Finished updating board flags in 1.585 seconds
2013-08-12 21:06:15 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 21:06:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 21:06:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 21:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:07:14 [DEBUG   ] Finished updating board flags in 2.250 seconds
2013-08-12 21:07:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 21:07:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 21:07:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 21:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:08:14 [DEBUG   ] Finished updating board flags in 2.077 seconds
2013-08-12 21:08:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 21:08:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 21:08:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 21:09:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:09:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:09:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:09:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:09:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:09:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:09:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:09:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:09:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:09:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:09:14 [DEBUG   ] Finished updating board flags in 2.008 seconds
2013-08-12 21:09:16 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-08-12 21:09:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 21:09:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 21:09:59 [DEBUG   ] Got command RPT from MCS: ref #16771
2013-08-12 21:09:59 [DEBUG   ] summary = ERROR
2013-08-12 21:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16771  13 56516 76199495 A  ERRORERROR'
2013-08-12 21:09:59 [DEBUG   ] Got command RPT from MCS: ref #16772
2013-08-12 21:09:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 21:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16772  77 56516 76199495 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 21:10:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:10:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:10:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:10:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:10:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:10:14 [DEBUG   ] Finished updating board flags in 1.983 seconds
2013-08-12 21:10:16 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2013-08-12 21:10:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 21:10:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 21:11:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:11:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:11:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:11:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:11:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:11:14 [DEBUG   ] Finished updating board flags in 1.824 seconds
2013-08-12 21:11:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 21:11:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 21:11:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 21:12:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:12:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:12:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:12:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:12:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:12:14 [DEBUG   ] Finished updating board flags in 1.778 seconds
2013-08-12 21:12:16 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-08-12 21:12:36 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 21:12:56 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-08-12 21:13:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:13:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:13:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:13:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:13:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:13:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:13:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:13:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:13:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:13:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:13:14 [DEBUG   ] Finished updating board flags in 1.622 seconds
2013-08-12 21:13:17 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2013-08-12 21:13:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 21:13:57 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 21:14:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:14:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:14:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:14:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:14:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:14:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:14:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:14:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:14:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:14:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:14:14 [DEBUG   ] Finished updating board flags in 1.577 seconds
2013-08-12 21:14:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 21:14:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 21:14:57 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 21:14:59 [DEBUG   ] Got command RPT from MCS: ref #16788
2013-08-12 21:14:59 [DEBUG   ] summary = ERROR
2013-08-12 21:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16788  13 56516 76499495 A  ERRORERROR'
2013-08-12 21:14:59 [DEBUG   ] Got command RPT from MCS: ref #16789
2013-08-12 21:14:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 21:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16789  77 56516 76499495 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 21:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:15:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:15:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:15:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:15:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:15:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:15:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:15:14 [DEBUG   ] Finished updating board flags in 1.419 seconds
2013-08-12 21:15:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 21:15:37 [DEBUG   ] Finished updating ant stats in 1.074 seconds
2013-08-12 21:15:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 21:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:16:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:16:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:16:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:16:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:16:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:16:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:16:14 [DEBUG   ] Finished updating board flags in 1.381 seconds
2013-08-12 21:16:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 21:16:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 21:16:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 21:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:17:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:17:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:17:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:17:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:17:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:17:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:17:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-12 21:17:14 [DEBUG   ] Finished updating board flags in 1.357 seconds
2013-08-12 21:17:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 21:17:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 21:17:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 21:18:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:18:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:18:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:18:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:18:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:18:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:18:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:18:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:18:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:18:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:18:15 [DEBUG   ] Finished updating board flags in 2.075 seconds
2013-08-12 21:18:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 21:18:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 21:18:57 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 21:19:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:19:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:19:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:19:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:19:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:19:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:19:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:19:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:19:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:19:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:19:15 [DEBUG   ] Finished updating board flags in 2.097 seconds
2013-08-12 21:19:17 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-12 21:19:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 21:19:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 21:19:59 [DEBUG   ] Got command RPT from MCS: ref #16805
2013-08-12 21:19:59 [DEBUG   ] summary = ERROR
2013-08-12 21:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16805  13 56516 76799495 A  ERRORERROR'
2013-08-12 21:19:59 [DEBUG   ] Got command RPT from MCS: ref #16806
2013-08-12 21:19:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 21:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16806  77 56516 76799495 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 21:20:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:20:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:20:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:20:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:20:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:20:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:20:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:20:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:20:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:20:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:20:15 [DEBUG   ] Finished updating board flags in 1.889 seconds
2013-08-12 21:20:17 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 21:20:37 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-08-12 21:20:58 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-08-12 21:21:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:21:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:21:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:21:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:21:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:21:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:21:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:21:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:21:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:21:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:21:15 [DEBUG   ] Finished updating board flags in 1.802 seconds
2013-08-12 21:21:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 21:21:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 21:21:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 21:22:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:22:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:22:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:22:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:22:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:22:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:22:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:22:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:22:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:22:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:22:15 [DEBUG   ] Finished updating board flags in 1.794 seconds
2013-08-12 21:22:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 21:22:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 21:22:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-12 21:23:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:23:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:23:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:23:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:23:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:23:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:23:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:23:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:23:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:23:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:23:15 [DEBUG   ] Finished updating board flags in 1.625 seconds
2013-08-12 21:23:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 21:23:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 21:23:58 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-12 21:24:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:24:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:24:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:24:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:24:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:24:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:24:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:24:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:24:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:24:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:24:15 [DEBUG   ] Finished updating board flags in 1.587 seconds
2013-08-12 21:24:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 21:24:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 21:24:58 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 21:24:59 [DEBUG   ] Got command RPT from MCS: ref #16822
2013-08-12 21:24:59 [DEBUG   ] summary = ERROR
2013-08-12 21:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16822  13 56516 77099495 A  ERRORERROR'
2013-08-12 21:24:59 [DEBUG   ] Got command RPT from MCS: ref #16823
2013-08-12 21:24:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 21:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16823  77 56516 77099495 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 21:25:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:25:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:25:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:25:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:25:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:25:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:25:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:25:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:25:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:25:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:25:15 [DEBUG   ] Finished updating board flags in 1.413 seconds
2013-08-12 21:25:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-12 21:25:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 21:25:58 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-12 21:26:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:26:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:26:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:26:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:26:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:26:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:26:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:26:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:26:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:26:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:26:15 [DEBUG   ] Finished updating board flags in 1.379 seconds
2013-08-12 21:26:18 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 21:26:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 21:26:58 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2013-08-12 21:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:27:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:27:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:27:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:27:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:27:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:27:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:27:15 [DEBUG   ] Finished updating board flags in 1.356 seconds
2013-08-12 21:27:18 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-08-12 21:27:39 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-08-12 21:27:59 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-08-12 21:28:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:28:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:28:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:28:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:28:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:28:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:28:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:28:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:28:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:28:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:28:16 [DEBUG   ] Finished updating board flags in 2.064 seconds
2013-08-12 21:28:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 21:28:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 21:28:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 21:29:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:29:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:29:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:29:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:29:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:29:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:29:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:29:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:29:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:29:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:29:16 [DEBUG   ] Finished updating board flags in 1.983 seconds
2013-08-12 21:29:19 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-12 21:29:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 21:29:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 21:29:59 [DEBUG   ] Got command RPT from MCS: ref #16839
2013-08-12 21:29:59 [DEBUG   ] summary = ERROR
2013-08-12 21:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16839  13 56516 77399499 A  ERRORERROR'
2013-08-12 21:29:59 [DEBUG   ] Got command RPT from MCS: ref #16840
2013-08-12 21:29:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 21:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16840  77 56516 77399499 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 21:30:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:30:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:30:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:30:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:30:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:30:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:30:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:30:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:30:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:30:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:30:16 [DEBUG   ] Finished updating board flags in 1.830 seconds
2013-08-12 21:30:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-12 21:30:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 21:30:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 21:31:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:31:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:31:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:31:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:31:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:31:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:31:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:31:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:31:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:31:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:31:16 [DEBUG   ] Finished updating board flags in 1.803 seconds
2013-08-12 21:31:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-12 21:31:40 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-08-12 21:31:59 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-12 21:32:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:32:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:32:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:32:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:32:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:32:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:32:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:32:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:32:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:32:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:32:16 [DEBUG   ] Finished updating board flags in 1.778 seconds
2013-08-12 21:32:20 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-08-12 21:32:40 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-08-12 21:33:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 21:33:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:33:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:33:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:33:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:33:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:33:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:33:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:33:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:33:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:33:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:33:16 [DEBUG   ] Finished updating board flags in 1.617 seconds
2013-08-12 21:33:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 21:33:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 21:34:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 21:34:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:34:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:34:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:34:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:34:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:34:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:34:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:34:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:34:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:34:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:34:16 [DEBUG   ] Finished updating board flags in 1.583 seconds
2013-08-12 21:34:20 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-12 21:34:40 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 21:34:59 [DEBUG   ] Got command RPT from MCS: ref #16856
2013-08-12 21:34:59 [DEBUG   ] summary = ERROR
2013-08-12 21:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16856  13 56516 77699499 A  ERRORERROR'
2013-08-12 21:34:59 [DEBUG   ] Got command RPT from MCS: ref #16857
2013-08-12 21:34:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 21:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16857  77 56516 77699499 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 21:35:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 21:35:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:35:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:35:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:35:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:35:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:35:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:35:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:35:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:35:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:35:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:35:16 [DEBUG   ] Finished updating board flags in 1.421 seconds
2013-08-12 21:35:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 21:35:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 21:36:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 21:36:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:36:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:36:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:36:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:36:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:36:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:36:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:36:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:36:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:36:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:36:16 [DEBUG   ] Finished updating board flags in 1.389 seconds
2013-08-12 21:36:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-12 21:36:41 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-08-12 21:37:00 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2013-08-12 21:37:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:37:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:37:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:37:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:37:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:37:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:37:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:37:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:37:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:37:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:37:16 [DEBUG   ] Finished updating board flags in 1.377 seconds
2013-08-12 21:37:21 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-08-12 21:37:41 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-12 21:38:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-12 21:38:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:38:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:38:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:38:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:38:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:38:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:38:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:38:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:38:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:38:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:38:17 [DEBUG   ] Finished updating board flags in 2.036 seconds
2013-08-12 21:38:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 21:38:41 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-12 21:39:01 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2013-08-12 21:39:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:39:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:39:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:39:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:39:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:39:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:39:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:39:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:39:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:39:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:39:17 [DEBUG   ] Finished updating board flags in 1.990 seconds
2013-08-12 21:39:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 21:39:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 21:39:59 [DEBUG   ] Got command RPT from MCS: ref #16873
2013-08-12 21:39:59 [DEBUG   ] summary = ERROR
2013-08-12 21:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16873  13 56516 77999499 A  ERRORERROR'
2013-08-12 21:39:59 [DEBUG   ] Got command RPT from MCS: ref #16874
2013-08-12 21:39:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 21:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16874  77 56516 77999499 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 21:40:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 21:40:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:40:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:40:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:40:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:40:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:40:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:40:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:40:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:40:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:40:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:40:17 [DEBUG   ] Finished updating board flags in 1.816 seconds
2013-08-12 21:40:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 21:40:41 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-12 21:41:01 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 21:41:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:41:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:41:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:41:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:41:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:41:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:41:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:41:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:41:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:41:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:41:17 [DEBUG   ] Finished updating board flags in 1.800 seconds
2013-08-12 21:41:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-12 21:41:42 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-08-12 21:42:01 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-12 21:42:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:42:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:42:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:42:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:42:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:42:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:42:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:42:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:42:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:42:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:42:17 [DEBUG   ] Finished updating board flags in 1.608 seconds
2013-08-12 21:42:22 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-08-12 21:42:42 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-12 21:43:02 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-12 21:43:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:43:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:43:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:43:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:43:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:43:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:43:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:43:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:43:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:43:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:43:17 [DEBUG   ] Finished updating board flags in 1.586 seconds
2013-08-12 21:43:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 21:43:42 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-12 21:44:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 21:44:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:44:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:44:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:44:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:44:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:44:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:44:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:44:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:44:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:44:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:44:17 [DEBUG   ] Finished updating board flags in 1.411 seconds
2013-08-12 21:44:22 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-12 21:44:42 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-12 21:44:59 [DEBUG   ] Got command RPT from MCS: ref #16890
2013-08-12 21:44:59 [DEBUG   ] summary = ERROR
2013-08-12 21:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16890  13 56516 78299499 A  ERRORERROR'
2013-08-12 21:44:59 [DEBUG   ] Got command RPT from MCS: ref #16891
2013-08-12 21:44:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 21:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16891  77 56516 78299499 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 21:45:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 21:45:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:45:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:45:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:45:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:45:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:45:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:45:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:45:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:45:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:45:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:45:17 [DEBUG   ] Finished updating board flags in 1.403 seconds
2013-08-12 21:45:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 21:45:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 21:46:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 21:46:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:46:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:46:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:46:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:46:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:46:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:46:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:46:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:46:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:46:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:46:17 [DEBUG   ] Finished updating board flags in 1.400 seconds
2013-08-12 21:46:22 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2013-08-12 21:46:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 21:47:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 21:47:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:47:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:47:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:47:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:47:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:47:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:47:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:47:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:47:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:47:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:47:17 [DEBUG   ] Finished updating board flags in 1.407 seconds
2013-08-12 21:47:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-12 21:47:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 21:48:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 21:48:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:48:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:48:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:48:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:48:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:48:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:48:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:48:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:48:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:48:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:48:17 [DEBUG   ] Finished updating board flags in 1.382 seconds
2013-08-12 21:48:23 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2013-08-12 21:48:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 21:49:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 21:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:49:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:49:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:49:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:49:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:49:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:49:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:49:17 [DEBUG   ] Finished updating board flags in 1.364 seconds
2013-08-12 21:49:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 21:49:43 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-08-12 21:49:59 [DEBUG   ] Got command RPT from MCS: ref #16907
2013-08-12 21:49:59 [DEBUG   ] summary = ERROR
2013-08-12 21:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16907  13 56516 78599503 A  ERRORERROR'
2013-08-12 21:49:59 [DEBUG   ] Got command RPT from MCS: ref #16908
2013-08-12 21:49:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 21:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16908  77 56516 78599503 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 21:50:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-12 21:50:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:50:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:50:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:50:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:50:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:50:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:50:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:50:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:50:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:50:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:50:18 [DEBUG   ] Finished updating board flags in 2.062 seconds
2013-08-12 21:50:24 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-08-12 21:50:44 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-08-12 21:51:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 21:51:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:51:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:51:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:51:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:51:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:51:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:51:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:51:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:51:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:51:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:51:18 [DEBUG   ] Finished updating board flags in 1.980 seconds
2013-08-12 21:51:24 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-12 21:51:44 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 21:52:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 21:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:52:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:52:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:52:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:52:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:52:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:52:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:52:18 [DEBUG   ] Finished updating board flags in 1.818 seconds
2013-08-12 21:52:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-12 21:52:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 21:53:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 21:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:53:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:53:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:53:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:53:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:53:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:53:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:53:18 [DEBUG   ] Finished updating board flags in 1.793 seconds
2013-08-12 21:53:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 21:53:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 21:54:04 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-12 21:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:54:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:54:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:54:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:54:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:54:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:54:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:54:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-12 21:54:18 [DEBUG   ] Finished updating board flags in 1.628 seconds
2013-08-12 21:54:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 21:54:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 21:54:59 [DEBUG   ] Got command RPT from MCS: ref #16924
2013-08-12 21:54:59 [DEBUG   ] summary = ERROR
2013-08-12 21:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16924  13 56516 78899499 A  ERRORERROR'
2013-08-12 21:54:59 [DEBUG   ] Got command RPT from MCS: ref #16925
2013-08-12 21:54:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 21:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16925  77 56516 78899499 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 21:55:04 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-12 21:55:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:55:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:55:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:55:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:55:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:55:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:55:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:55:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:55:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:55:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:55:18 [DEBUG   ] Finished updating board flags in 1.575 seconds
2013-08-12 21:55:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 21:55:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 21:56:05 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-08-12 21:56:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:56:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:56:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:56:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:56:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:56:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:56:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:56:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:56:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:56:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:56:18 [DEBUG   ] Finished updating board flags in 1.419 seconds
2013-08-12 21:56:25 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-08-12 21:56:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 21:57:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 21:57:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:57:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:57:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:57:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:57:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:57:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:57:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:57:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:57:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:57:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:57:18 [DEBUG   ] Finished updating board flags in 1.378 seconds
2013-08-12 21:57:25 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-12 21:57:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 21:58:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 21:58:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:58:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:58:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:58:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:58:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:58:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:58:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:58:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:58:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:58:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:58:18 [DEBUG   ] Finished updating board flags in 1.373 seconds
2013-08-12 21:58:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-12 21:58:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 21:59:05 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-12 21:59:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 21:59:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 21:59:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 21:59:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 21:59:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 21:59:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 21:59:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 21:59:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 21:59:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 21:59:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 21:59:19 [DEBUG   ] Finished updating board flags in 2.054 seconds
2013-08-12 21:59:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 21:59:45 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2013-08-12 21:59:59 [DEBUG   ] Got command RPT from MCS: ref #16941
2013-08-12 21:59:59 [DEBUG   ] summary = ERROR
2013-08-12 21:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16941  13 56516 79199503 A  ERRORERROR'
2013-08-12 21:59:59 [DEBUG   ] Got command RPT from MCS: ref #16942
2013-08-12 21:59:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 21:59:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16942  77 56516 79199503 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 22:00:06 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-12 22:00:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 22:00:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 22:00:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 22:00:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 22:00:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 22:00:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 22:00:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 22:00:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 22:00:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 22:00:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 22:00:19 [DEBUG   ] Finished updating board flags in 1.980 seconds
2013-08-12 22:00:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 22:00:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-12 22:01:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 22:01:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-08-12 22:01:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-08-12 22:01:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-08-12 22:01:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-08-12 22:01:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-08-12 22:01:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-08-12 22:01:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-08-12 22:01:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-08-12 22:01:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-08-12 22:01:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-08-12 22:01:19 [DEBUG   ] Finished updating board flags in 1.816 seconds
2013-08-12 22:01:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 22:01:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 22:02:06 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-08-12 22:02:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-08-12 22:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-08-12 22:02:19 [DEBUG   ] Finished updating board flags in 1.823 seconds
2013-08-12 22:02:26 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-12 22:02:46 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-12 22:03:07 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-12 22:03:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-12 22:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-12 22:03:19 [DEBUG   ] Finished updating board flags in 1.783 seconds
2013-08-12 22:03:27 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2013-08-12 22:03:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 22:04:07 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 22:04:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-08-12 22:04:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-08-12 22:04:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-08-12 22:04:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-08-12 22:04:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-08-12 22:04:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-08-12 22:04:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-08-12 22:04:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-08-12 22:04:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-08-12 22:04:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-08-12 22:04:19 [DEBUG   ] Finished updating board flags in 1.610 seconds
2013-08-12 22:04:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 22:04:47 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-12 22:04:59 [DEBUG   ] Got command RPT from MCS: ref #16958
2013-08-12 22:04:59 [DEBUG   ] summary = ERROR
2013-08-12 22:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16958  13 56516 79499507 A  ERRORERROR'
2013-08-12 22:04:59 [DEBUG   ] Got command RPT from MCS: ref #16959
2013-08-12 22:04:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 22:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16959  77 56516 79499507 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 22:05:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-08-12 22:05:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-08-12 22:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-08-12 22:05:19 [DEBUG   ] Finished updating board flags in 1.599 seconds
2013-08-12 22:05:27 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2013-08-12 22:05:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 22:06:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-12 22:06:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-12 22:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-12 22:06:19 [DEBUG   ] Finished updating board flags in 1.418 seconds
2013-08-12 22:06:27 [DEBUG   ] Finished updating ant stats in 0.593 seconds
2013-08-12 22:06:47 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2013-08-12 22:07:08 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-12 22:07:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:07:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:07:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:07:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:07:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:07:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:07:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:07:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:07:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:07:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:07:19 [DEBUG   ] Finished updating board flags in 1.373 seconds
2013-08-12 22:07:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 22:07:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 22:08:08 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-12 22:08:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:08:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:08:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:08:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:08:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:08:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:08:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:08:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:08:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:08:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:08:19 [DEBUG   ] Finished updating board flags in 1.362 seconds
2013-08-12 22:08:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 22:08:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 22:09:08 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-12 22:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:09:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:09:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:09:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:09:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:09:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:09:20 [DEBUG   ] Finished updating board flags in 2.053 seconds
2013-08-12 22:09:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 22:09:48 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2013-08-12 22:09:59 [DEBUG   ] Got command RPT from MCS: ref #16975
2013-08-12 22:09:59 [DEBUG   ] summary = ERROR
2013-08-12 22:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16975  13 56516 79799507 A  ERRORERROR'
2013-08-12 22:09:59 [DEBUG   ] Got command RPT from MCS: ref #16976
2013-08-12 22:09:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 22:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16976  77 56516 79799507 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 22:10:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 22:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:10:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:10:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:10:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:10:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:10:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:10:20 [DEBUG   ] Finished updating board flags in 2.073 seconds
2013-08-12 22:10:29 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2013-08-12 22:10:49 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2013-08-12 22:11:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 22:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:11:20 [DEBUG   ] Finished updating board flags in 1.918 seconds
2013-08-12 22:11:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 22:11:49 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-12 22:12:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 22:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:12:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:12:20 [DEBUG   ] Finished updating board flags in 1.825 seconds
2013-08-12 22:12:29 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 22:12:49 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 22:13:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 22:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:13:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:13:20 [DEBUG   ] Finished updating board flags in 1.779 seconds
2013-08-12 22:13:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 22:13:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 22:14:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 22:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:14:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:14:20 [DEBUG   ] Finished updating board flags in 1.617 seconds
2013-08-12 22:14:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 22:14:49 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2013-08-12 22:14:59 [DEBUG   ] Got command RPT from MCS: ref #16992
2013-08-12 22:14:59 [DEBUG   ] summary = ERROR
2013-08-12 22:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16992  13 56516 80099507 A  ERRORERROR'
2013-08-12 22:14:59 [DEBUG   ] Got command RPT from MCS: ref #16993
2013-08-12 22:14:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 22:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    16993  77 56516 80099507 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 22:15:09 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-08-12 22:15:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:15:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:15:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:15:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:15:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:15:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:15:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:15:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:15:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:15:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:15:20 [DEBUG   ] Finished updating board flags in 1.610 seconds
2013-08-12 22:15:30 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-08-12 22:15:50 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2013-08-12 22:16:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 22:16:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:16:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:16:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:16:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:16:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:16:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:16:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:16:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:16:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:16:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:16:20 [DEBUG   ] Finished updating board flags in 1.580 seconds
2013-08-12 22:16:30 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2013-08-12 22:16:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 22:17:10 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-08-12 22:17:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:17:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:17:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:17:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:17:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:17:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:17:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:17:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:17:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:17:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:17:20 [DEBUG   ] Finished updating board flags in 1.423 seconds
2013-08-12 22:17:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 22:17:50 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-12 22:18:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 22:18:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:18:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:18:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:18:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:18:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:18:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:18:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:18:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:18:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:18:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:18:20 [DEBUG   ] Finished updating board flags in 1.387 seconds
2013-08-12 22:18:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 22:18:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 22:19:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 22:19:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:19:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:19:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:19:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:19:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:19:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:19:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:19:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:19:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:19:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:19:20 [DEBUG   ] Finished updating board flags in 1.381 seconds
2013-08-12 22:19:31 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-08-12 22:19:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 22:19:59 [DEBUG   ] Got command RPT from MCS: ref #17009
2013-08-12 22:19:59 [DEBUG   ] summary = ERROR
2013-08-12 22:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17009  13 56516 80399511 A  ERRORERROR'
2013-08-12 22:19:59 [DEBUG   ] Got command RPT from MCS: ref #17010
2013-08-12 22:19:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 22:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17010  77 56516 80399511 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 22:20:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 22:20:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:20:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:20:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:20:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:20:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:20:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:20:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:20:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:20:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:20:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:20:21 [DEBUG   ] Finished updating board flags in 2.039 seconds
2013-08-12 22:20:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 22:20:51 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-08-12 22:21:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 22:21:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:21:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:21:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:21:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:21:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:21:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:21:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:21:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:21:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:21:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:21:21 [DEBUG   ] Finished updating board flags in 2.008 seconds
2013-08-12 22:21:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 22:21:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 22:22:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 22:22:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:22:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:22:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:22:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:22:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:22:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:22:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:22:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:22:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:22:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:22:21 [DEBUG   ] Finished updating board flags in 1.976 seconds
2013-08-12 22:22:31 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2013-08-12 22:22:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 22:23:11 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-08-12 22:23:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:23:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:23:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:23:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:23:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:23:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:23:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:23:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:23:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:23:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:23:21 [DEBUG   ] Finished updating board flags in 1.822 seconds
2013-08-12 22:23:32 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-08-12 22:23:52 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2013-08-12 22:24:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 22:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:24:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:24:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:24:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:24:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:24:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:24:21 [DEBUG   ] Finished updating board flags in 1.799 seconds
2013-08-12 22:24:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 22:24:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 22:24:59 [DEBUG   ] Got command RPT from MCS: ref #17026
2013-08-12 22:24:59 [DEBUG   ] summary = ERROR
2013-08-12 22:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17026  13 56516 80699507 A  ERRORERROR'
2013-08-12 22:24:59 [DEBUG   ] Got command RPT from MCS: ref #17027
2013-08-12 22:24:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 22:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17027  77 56516 80699507 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 22:25:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-12 22:25:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:25:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:25:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:25:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:25:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:25:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:25:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:25:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:25:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:25:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:25:21 [DEBUG   ] Finished updating board flags in 1.603 seconds
2013-08-12 22:25:32 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2013-08-12 22:25:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 22:26:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 22:26:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:26:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:26:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:26:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:26:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:26:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:26:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:26:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:26:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:26:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:26:21 [DEBUG   ] Finished updating board flags in 1.612 seconds
2013-08-12 22:26:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 22:26:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 22:27:12 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 22:27:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:27:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:27:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:27:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:27:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:27:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:27:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:27:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:27:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:27:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:27:21 [DEBUG   ] Finished updating board flags in 1.585 seconds
2013-08-12 22:27:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 22:27:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 22:28:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 22:28:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:28:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:28:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:28:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:28:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:28:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:28:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:28:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:28:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:28:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:28:21 [DEBUG   ] Finished updating board flags in 1.408 seconds
2013-08-12 22:28:32 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 22:28:52 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-12 22:29:13 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2013-08-12 22:29:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:29:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:29:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:29:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:29:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:29:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:29:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:29:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:29:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:29:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:29:21 [DEBUG   ] Finished updating board flags in 1.385 seconds
2013-08-12 22:29:32 [DEBUG   ] Finished updating ant stats in 0.407 seconds
2013-08-12 22:29:52 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-08-12 22:29:59 [DEBUG   ] Got command RPT from MCS: ref #17043
2013-08-12 22:29:59 [DEBUG   ] summary = ERROR
2013-08-12 22:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17043  13 56516 80999511 A  ERRORERROR'
2013-08-12 22:29:59 [DEBUG   ] Got command RPT from MCS: ref #17044
2013-08-12 22:29:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 22:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17044  77 56516 80999511 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 22:30:13 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2013-08-12 22:30:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:30:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:30:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:30:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:30:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:30:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:30:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:30:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:30:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:30:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:30:21 [DEBUG   ] Finished updating board flags in 1.374 seconds
2013-08-12 22:30:33 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-12 22:30:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 22:31:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 22:31:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:31:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:31:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:31:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:31:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:31:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:31:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:31:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:31:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:31:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:31:22 [DEBUG   ] Finished updating board flags in 2.066 seconds
2013-08-12 22:31:33 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2013-08-12 22:31:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 22:32:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 22:32:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:32:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:32:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:32:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:32:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:32:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:32:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:32:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:32:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:32:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:32:22 [DEBUG   ] Finished updating board flags in 1.967 seconds
2013-08-12 22:32:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 22:32:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 22:33:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 22:33:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:33:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:33:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:33:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:33:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:33:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:33:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:33:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:33:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:33:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:33:22 [DEBUG   ] Finished updating board flags in 1.911 seconds
2013-08-12 22:33:33 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 22:33:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 22:34:13 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-12 22:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:34:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:34:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:34:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:34:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:34:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:34:22 [DEBUG   ] Finished updating board flags in 1.695 seconds
2013-08-12 22:34:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 22:34:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 22:34:59 [DEBUG   ] Got command RPT from MCS: ref #17060
2013-08-12 22:34:59 [DEBUG   ] summary = ERROR
2013-08-12 22:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17060  13 56516 81299515 A  ERRORERROR'
2013-08-12 22:34:59 [DEBUG   ] Got command RPT from MCS: ref #17061
2013-08-12 22:34:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 22:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17061  77 56516 81299515 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 22:35:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-12 22:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:35:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:35:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:35:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:35:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:35:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:35:22 [DEBUG   ] Finished updating board flags in 1.628 seconds
2013-08-12 22:35:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 22:35:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 22:36:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 22:36:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:36:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:36:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:36:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:36:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:36:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:36:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:36:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:36:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:36:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:36:22 [DEBUG   ] Finished updating board flags in 1.606 seconds
2013-08-12 22:36:33 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2013-08-12 22:36:54 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-08-12 22:37:14 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-12 22:37:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:37:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:37:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:37:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:37:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:37:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:37:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:37:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:37:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:37:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:37:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-12 22:37:22 [DEBUG   ] Finished updating board flags in 1.583 seconds
2013-08-12 22:37:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 22:37:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 22:38:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 22:38:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:38:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:38:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:38:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:38:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:38:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:38:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:38:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:38:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:38:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:38:22 [DEBUG   ] Finished updating board flags in 1.413 seconds
2013-08-12 22:38:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 22:38:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 22:39:14 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 22:39:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:39:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:39:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:39:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:39:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:39:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:39:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:39:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:39:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:39:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:39:22 [DEBUG   ] Finished updating board flags in 1.383 seconds
2013-08-12 22:39:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 22:39:54 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 22:39:59 [DEBUG   ] Got command RPT from MCS: ref #17077
2013-08-12 22:39:59 [DEBUG   ] summary = ERROR
2013-08-12 22:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17077  13 56516 81599515 A  ERRORERROR'
2013-08-12 22:39:59 [DEBUG   ] Got command RPT from MCS: ref #17078
2013-08-12 22:39:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 22:39:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17078  77 56516 81599515 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 22:40:14 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2013-08-12 22:40:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:40:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:40:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:40:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:40:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:40:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:40:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:40:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:40:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:40:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:40:22 [DEBUG   ] Finished updating board flags in 1.493 seconds
2013-08-12 22:40:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 22:40:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 22:41:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 22:41:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:41:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:41:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:41:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:41:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:41:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:41:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:41:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:41:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:41:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:41:23 [DEBUG   ] Finished updating board flags in 2.191 seconds
2013-08-12 22:41:34 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-08-12 22:41:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 22:42:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 22:42:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:42:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:42:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:42:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:42:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:42:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:42:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:42:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:42:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:42:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:42:23 [DEBUG   ] Finished updating board flags in 1.925 seconds
2013-08-12 22:42:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 22:42:54 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2013-08-12 22:43:15 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-08-12 22:43:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:43:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:43:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:43:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:43:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:43:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:43:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:43:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:43:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:43:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:43:23 [DEBUG   ] Finished updating board flags in 1.813 seconds
2013-08-12 22:43:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 22:43:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 22:44:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 22:44:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:44:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:44:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:44:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:44:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:44:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:44:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:44:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:44:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:44:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:44:23 [DEBUG   ] Finished updating board flags in 1.794 seconds
2013-08-12 22:44:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 22:44:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 22:44:59 [DEBUG   ] Got command RPT from MCS: ref #17094
2013-08-12 22:44:59 [DEBUG   ] summary = ERROR
2013-08-12 22:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17094  13 56516 81899511 A  ERRORERROR'
2013-08-12 22:44:59 [DEBUG   ] Got command RPT from MCS: ref #17095
2013-08-12 22:44:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 22:44:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17095  77 56516 81899511 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 22:45:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 22:45:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:45:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:45:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:45:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:45:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:45:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:45:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:45:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:45:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:45:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:45:23 [DEBUG   ] Finished updating board flags in 1.642 seconds
2013-08-12 22:45:35 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 22:45:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 22:46:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 22:46:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:46:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:46:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:46:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:46:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:46:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:46:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:46:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:46:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:46:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:46:23 [DEBUG   ] Finished updating board flags in 1.613 seconds
2013-08-12 22:46:35 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2013-08-12 22:46:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 22:47:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 22:47:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:47:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:47:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:47:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:47:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:47:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:47:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:47:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:47:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:47:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:47:23 [DEBUG   ] Finished updating board flags in 1.546 seconds
2013-08-12 22:47:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 22:47:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 22:48:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 22:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:48:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:48:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:48:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:48:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:48:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:48:23 [DEBUG   ] Finished updating board flags in 1.443 seconds
2013-08-12 22:48:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 22:48:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 22:49:15 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2013-08-12 22:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:49:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:49:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:49:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:49:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:49:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:49:23 [DEBUG   ] Finished updating board flags in 1.510 seconds
2013-08-12 22:49:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 22:49:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 22:49:59 [DEBUG   ] Got command RPT from MCS: ref #17111
2013-08-12 22:49:59 [DEBUG   ] summary = ERROR
2013-08-12 22:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17111  13 56516 82199515 A  ERRORERROR'
2013-08-12 22:49:59 [DEBUG   ] Got command RPT from MCS: ref #17112
2013-08-12 22:49:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 22:49:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17112  77 56516 82199515 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 22:50:15 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-08-12 22:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:50:23 [DEBUG   ] Finished updating board flags in 1.507 seconds
2013-08-12 22:50:35 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-08-12 22:50:56 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-08-12 22:51:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 22:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:51:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:51:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:51:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:51:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:51:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:51:24 [DEBUG   ] Finished updating board flags in 2.239 seconds
2013-08-12 22:51:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 22:51:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 22:52:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 22:52:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:52:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:52:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:52:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:52:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:52:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:52:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:52:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:52:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:52:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:52:24 [DEBUG   ] Finished updating board flags in 2.112 seconds
2013-08-12 22:52:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 22:52:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 22:53:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 22:53:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:53:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:53:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:53:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:53:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:53:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:53:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:53:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:53:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:53:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:53:24 [DEBUG   ] Finished updating board flags in 2.021 seconds
2013-08-12 22:53:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 22:53:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 22:54:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-12 22:54:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:54:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:54:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:54:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:54:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:54:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:54:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:54:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:54:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:54:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:54:24 [DEBUG   ] Finished updating board flags in 2.033 seconds
2013-08-12 22:54:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 22:54:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 22:54:59 [DEBUG   ] Got command RPT from MCS: ref #17128
2013-08-12 22:54:59 [DEBUG   ] summary = ERROR
2013-08-12 22:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17128  13 56516 82499515 A  ERRORERROR'
2013-08-12 22:54:59 [DEBUG   ] Got command RPT from MCS: ref #17129
2013-08-12 22:54:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 22:54:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17129  77 56516 82499515 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 22:55:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 22:55:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:55:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:55:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:55:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:55:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:55:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:55:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:55:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:55:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:55:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:55:24 [DEBUG   ] Finished updating board flags in 2.013 seconds
2013-08-12 22:55:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 22:55:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 22:56:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 22:56:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:56:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:56:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:56:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:56:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:56:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:56:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:56:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:56:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:56:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:56:24 [DEBUG   ] Finished updating board flags in 1.942 seconds
2013-08-12 22:56:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 22:56:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 22:57:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 22:57:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:57:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:57:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:57:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:57:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:57:24 [DEBUG   ] Finished updating board flags in 1.878 seconds
2013-08-12 22:57:35 [DEBUG   ] Got command RPT from MCS: ref #17145
2013-08-12 22:57:35 [DEBUG   ] summary = ERROR
2013-08-12 22:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17145  13 56516 82655951 A  ERRORERROR'
2013-08-12 22:57:35 [DEBUG   ] Got command RPT from MCS: ref #17146
2013-08-12 22:57:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 22:57:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17146  77 56516 82655951 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 22:57:36 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2013-08-12 22:57:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 22:58:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 22:58:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:58:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:58:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:58:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:58:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:58:24 [DEBUG   ] Finished updating board flags in 1.732 seconds
2013-08-12 22:58:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-12 22:58:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 22:59:16 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2013-08-12 22:59:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 22:59:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 22:59:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 22:59:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 22:59:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 22:59:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 22:59:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 22:59:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 22:59:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 22:59:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 22:59:24 [DEBUG   ] Finished updating board flags in 1.618 seconds
2013-08-12 22:59:37 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-08-12 22:59:57 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-08-12 23:00:17 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2013-08-12 23:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:00:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:00:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:00:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:00:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:00:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:00:24 [DEBUG   ] Finished updating board flags in 1.585 seconds
2013-08-12 23:00:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 23:00:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-12 23:01:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 23:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:01:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:01:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:01:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:01:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:01:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:01:24 [DEBUG   ] Finished updating board flags in 1.414 seconds
2013-08-12 23:01:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 23:01:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 23:02:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-12 23:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:02:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:02:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:02:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:02:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:02:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:02:24 [DEBUG   ] Finished updating board flags in 1.385 seconds
2013-08-12 23:02:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 23:02:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 23:03:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 23:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:03:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:03:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:03:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:03:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:03:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:03:24 [DEBUG   ] Finished updating board flags in 1.452 seconds
2013-08-12 23:03:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 23:03:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 23:04:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 23:04:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:04:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:04:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:04:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:04:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:04:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:04:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:04:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:04:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:04:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:04:25 [DEBUG   ] Finished updating board flags in 2.258 seconds
2013-08-12 23:04:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 23:04:45 [DEBUG   ] Got command RPT from MCS: ref #17162
2013-08-12 23:04:45 [DEBUG   ] summary = ERROR
2013-08-12 23:04:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17162  13 56516 83085399 A  ERRORERROR'
2013-08-12 23:04:45 [DEBUG   ] Got command RPT from MCS: ref #17163
2013-08-12 23:04:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 23:04:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17163  77 56516 83085399 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 23:04:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 23:05:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 23:05:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:05:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:05:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:05:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:05:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:05:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:05:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:05:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:05:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:05:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:05:25 [DEBUG   ] Finished updating board flags in 2.240 seconds
2013-08-12 23:05:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 23:05:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 23:06:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 23:06:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:06:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:06:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:06:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:06:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:06:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:06:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:06:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:06:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:06:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:06:25 [DEBUG   ] Finished updating board flags in 2.069 seconds
2013-08-12 23:06:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 23:06:37 [DEBUG   ] Got command RPT from MCS: ref #17179
2013-08-12 23:06:37 [DEBUG   ] summary = ERROR
2013-08-12 23:06:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17179  13 56516 83197907 A  ERRORERROR'
2013-08-12 23:06:37 [DEBUG   ] Got command RPT from MCS: ref #17180
2013-08-12 23:06:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 23:06:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17180  77 56516 83197907 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 23:06:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 23:07:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 23:07:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:07:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:07:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:07:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:07:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:07:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:07:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:07:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:07:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:07:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:07:25 [DEBUG   ] Finished updating board flags in 2.025 seconds
2013-08-12 23:07:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 23:07:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 23:08:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 23:08:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:08:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:08:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:08:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:08:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:08:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:08:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:08:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:08:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:08:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:08:25 [DEBUG   ] Finished updating board flags in 1.975 seconds
2013-08-12 23:08:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 23:08:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 23:08:59 [DEBUG   ] Got command RPT from MCS: ref #17196
2013-08-12 23:08:59 [DEBUG   ] summary = ERROR
2013-08-12 23:08:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17196  13 56516 83339955 A  ERRORERROR'
2013-08-12 23:08:59 [DEBUG   ] Got command RPT from MCS: ref #17197
2013-08-12 23:08:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 23:08:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17197  77 56516 83339955 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 23:09:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 23:09:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:09:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:09:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:09:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:09:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:09:25 [DEBUG   ] Finished updating board flags in 1.819 seconds
2013-08-12 23:09:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 23:09:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 23:10:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 23:10:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:10:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:10:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:10:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:10:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:10:25 [DEBUG   ] Finished updating board flags in 1.781 seconds
2013-08-12 23:10:37 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-08-12 23:10:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 23:11:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 23:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:11:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:11:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:11:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:11:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:11:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:11:25 [DEBUG   ] Finished updating board flags in 1.611 seconds
2013-08-12 23:11:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 23:11:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 23:12:17 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 23:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:12:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:12:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:12:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:12:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:12:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:12:25 [DEBUG   ] Finished updating board flags in 1.706 seconds
2013-08-12 23:12:37 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-08-12 23:12:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 23:13:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 23:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:13:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:13:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:13:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:13:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:13:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:13:25 [DEBUG   ] Finished updating board flags in 1.483 seconds
2013-08-12 23:13:37 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2013-08-12 23:13:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-08-12 23:13:59 [DEBUG   ] Got command RPT from MCS: ref #17213
2013-08-12 23:13:59 [DEBUG   ] summary = ERROR
2013-08-12 23:13:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17213  13 56516 83639951 A  ERRORERROR'
2013-08-12 23:13:59 [DEBUG   ] Got command RPT from MCS: ref #17214
2013-08-12 23:13:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 23:13:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17214  77 56516 83639951 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 23:14:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-12 23:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:14:25 [DEBUG   ] Finished updating board flags in 1.471 seconds
2013-08-12 23:14:38 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-08-12 23:14:58 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-08-12 23:15:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-12 23:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:15:25 [DEBUG   ] Finished updating board flags in 1.471 seconds
2013-08-12 23:15:38 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 23:15:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 23:16:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 23:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:16:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:16:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:16:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:16:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:16:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:16:25 [DEBUG   ] Finished updating board flags in 1.476 seconds
2013-08-12 23:16:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-12 23:16:58 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-08-12 23:17:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 23:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:17:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:17:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:17:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:17:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:17:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:17:25 [DEBUG   ] Finished updating board flags in 1.473 seconds
2013-08-12 23:17:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 23:17:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 23:18:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 23:18:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:18:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:18:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:18:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:18:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:18:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:18:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:18:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:18:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:18:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:18:26 [DEBUG   ] Finished updating board flags in 2.140 seconds
2013-08-12 23:18:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 23:18:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 23:18:59 [DEBUG   ] Got command RPT from MCS: ref #17230
2013-08-12 23:18:59 [DEBUG   ] summary = ERROR
2013-08-12 23:18:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17230  13 56516 83939955 A  ERRORERROR'
2013-08-12 23:18:59 [DEBUG   ] Got command RPT from MCS: ref #17231
2013-08-12 23:18:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 23:18:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17231  77 56516 83939955 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 23:19:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 23:19:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:19:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:19:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:19:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:19:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:19:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:19:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:19:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:19:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:19:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:19:26 [DEBUG   ] Finished updating board flags in 1.987 seconds
2013-08-12 23:19:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 23:19:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 23:20:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 23:20:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:20:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:20:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:20:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:20:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:20:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:20:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:20:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:20:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:20:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:20:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-08-12 23:20:26 [CRITICAL] MGT underflow detected on beam(s) 1
2013-08-12 23:20:26 [DEBUG   ] Finished updating board flags in 1.824 seconds
2013-08-12 23:20:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 23:20:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 23:21:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 23:21:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:21:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:21:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:21:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:21:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:21:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:21:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:21:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:21:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:21:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:21:26 [DEBUG   ] Finished updating board flags in 1.774 seconds
2013-08-12 23:21:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 23:21:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 23:22:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 23:22:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:22:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:22:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:22:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:22:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:22:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:22:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:22:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:22:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:22:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:22:26 [DEBUG   ] Finished updating board flags in 1.711 seconds
2013-08-12 23:22:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 23:22:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 23:23:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 23:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:23:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:23:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:23:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:23:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:23:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:23:26 [DEBUG   ] Finished updating board flags in 1.635 seconds
2013-08-12 23:23:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 23:23:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 23:23:59 [DEBUG   ] Got command RPT from MCS: ref #17247
2013-08-12 23:23:59 [DEBUG   ] summary = ERROR
2013-08-12 23:23:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17247  13 56516 84239959 A  ERRORERROR'
2013-08-12 23:23:59 [DEBUG   ] Got command RPT from MCS: ref #17248
2013-08-12 23:23:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 23:23:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17248  77 56516 84239959 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 23:24:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 23:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:24:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:24:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:24:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:24:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:24:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:24:26 [DEBUG   ] Finished updating board flags in 1.476 seconds
2013-08-12 23:24:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 23:24:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 23:25:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 23:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:25:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:25:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:25:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:25:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:25:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:25:26 [DEBUG   ] Finished updating board flags in 1.490 seconds
2013-08-12 23:25:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 23:25:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 23:26:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 23:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:26:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:26:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:26:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:26:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:26:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:26:26 [DEBUG   ] Finished updating board flags in 1.501 seconds
2013-08-12 23:26:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 23:26:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 23:27:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 23:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:27:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:27:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:27:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:27:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:27:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:27:26 [DEBUG   ] Finished updating board flags in 1.518 seconds
2013-08-12 23:27:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 23:27:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 23:28:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 23:28:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:28:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:28:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:28:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:28:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:28:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:28:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:28:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:28:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:28:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:28:27 [DEBUG   ] Finished updating board flags in 2.153 seconds
2013-08-12 23:28:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 23:28:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 23:28:59 [DEBUG   ] Got command RPT from MCS: ref #17264
2013-08-12 23:28:59 [DEBUG   ] summary = ERROR
2013-08-12 23:28:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17264  13 56516 84539955 A  ERRORERROR'
2013-08-12 23:28:59 [DEBUG   ] Got command RPT from MCS: ref #17265
2013-08-12 23:28:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 23:28:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17265  77 56516 84539955 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 23:29:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 23:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:29:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:29:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:29:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:29:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:29:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:29:27 [DEBUG   ] Finished updating board flags in 2.070 seconds
2013-08-12 23:29:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 23:29:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 23:30:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 23:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:30:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:30:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:30:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:30:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:30:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:30:27 [DEBUG   ] Finished updating board flags in 1.964 seconds
2013-08-12 23:30:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 23:30:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 23:31:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 23:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:31:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:31:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:31:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:31:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:31:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:31:27 [DEBUG   ] Finished updating board flags in 1.747 seconds
2013-08-12 23:31:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 23:31:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 23:32:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 23:32:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:32:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:32:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:32:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:32:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:32:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:32:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:32:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:32:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:32:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:32:27 [DEBUG   ] Finished updating board flags in 1.553 seconds
2013-08-12 23:32:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 23:32:58 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-08-12 23:33:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 23:33:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:33:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:33:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:33:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:33:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:33:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:33:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:33:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:33:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:33:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:33:27 [DEBUG   ] Finished updating board flags in 1.432 seconds
2013-08-12 23:33:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 23:33:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 23:33:59 [DEBUG   ] Got command RPT from MCS: ref #17281
2013-08-12 23:33:59 [DEBUG   ] summary = ERROR
2013-08-12 23:33:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17281  13 56516 84839959 A  ERRORERROR'
2013-08-12 23:33:59 [DEBUG   ] Got command RPT from MCS: ref #17282
2013-08-12 23:33:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 23:33:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17282  77 56516 84839959 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 23:34:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 23:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:34:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:34:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:34:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:34:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:34:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:34:27 [DEBUG   ] Finished updating board flags in 1.532 seconds
2013-08-12 23:34:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 23:34:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 23:35:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 23:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:35:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:35:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:35:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:35:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:35:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:35:27 [DEBUG   ] Finished updating board flags in 1.543 seconds
2013-08-12 23:35:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 23:35:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 23:36:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 23:36:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:36:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:36:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:36:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:36:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:36:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:36:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:36:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:36:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:36:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:36:28 [DEBUG   ] Finished updating board flags in 2.220 seconds
2013-08-12 23:36:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 23:36:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 23:37:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 23:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:37:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:37:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:37:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:37:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:37:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:37:28 [DEBUG   ] Finished updating board flags in 2.095 seconds
2013-08-12 23:37:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-12 23:37:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-12 23:38:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 23:38:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:38:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:38:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:38:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:38:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:38:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:38:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:38:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:38:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:38:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:38:28 [DEBUG   ] Finished updating board flags in 2.026 seconds
2013-08-12 23:38:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-12 23:38:58 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-08-12 23:38:59 [DEBUG   ] Got command RPT from MCS: ref #17298
2013-08-12 23:38:59 [DEBUG   ] summary = ERROR
2013-08-12 23:38:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17298  13 56516 85139963 A  ERRORERROR'
2013-08-12 23:38:59 [DEBUG   ] Got command RPT from MCS: ref #17299
2013-08-12 23:38:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 23:38:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17299  77 56516 85139963 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 23:39:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-12 23:39:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:39:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:39:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:39:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:39:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:39:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:39:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:39:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:39:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:39:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:39:28 [DEBUG   ] Finished updating board flags in 1.973 seconds
2013-08-12 23:39:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-08-12 23:39:59 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-08-12 23:40:19 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-08-12 23:40:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:40:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:40:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:40:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:40:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:40:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:40:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:40:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:40:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:40:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:40:28 [DEBUG   ] Finished updating board flags in 1.820 seconds
2013-08-12 23:40:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 23:40:59 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-08-12 23:41:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 23:41:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:41:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:41:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:41:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:41:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:41:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:41:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:41:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:41:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:41:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:41:28 [DEBUG   ] Finished updating board flags in 1.772 seconds
2013-08-12 23:41:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 23:41:59 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-12 23:42:19 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-08-12 23:42:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:42:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:42:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:42:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:42:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:42:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:42:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:42:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:42:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:42:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:42:28 [DEBUG   ] Finished updating board flags in 1.618 seconds
2013-08-12 23:42:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 23:42:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 23:43:19 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-08-12 23:43:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:43:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:43:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:43:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:43:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:43:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:43:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:43:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:43:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:43:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:43:28 [DEBUG   ] Finished updating board flags in 1.580 seconds
2013-08-12 23:43:39 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-08-12 23:43:59 [DEBUG   ] Got command RPT from MCS: ref #17315
2013-08-12 23:43:59 [DEBUG   ] summary = ERROR
2013-08-12 23:43:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17315  13 56516 85439959 A  ERRORERROR'
2013-08-12 23:43:59 [DEBUG   ] Got command RPT from MCS: ref #17316
2013-08-12 23:43:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 23:43:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17316  77 56516 85439959 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 23:44:00 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-08-12 23:44:20 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-08-12 23:44:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:44:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:44:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:44:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:44:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:44:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:44:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:44:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:44:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:44:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:44:28 [DEBUG   ] Finished updating board flags in 1.423 seconds
2013-08-12 23:44:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 23:45:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 23:45:20 [DEBUG   ] Finished updating ant stats in 1.190 seconds
2013-08-12 23:45:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:45:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:45:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:45:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:45:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:45:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:45:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:45:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:45:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:45:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:45:29 [DEBUG   ] Finished updating board flags in 2.401 seconds
2013-08-12 23:45:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 23:46:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 23:46:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-12 23:46:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:46:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:46:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:46:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:46:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:46:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:46:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:46:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:46:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:46:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:46:28 [DEBUG   ] Finished updating board flags in 1.382 seconds
2013-08-12 23:46:40 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-08-12 23:47:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 23:47:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 23:47:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:47:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:47:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:47:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:47:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:47:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:47:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:47:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:47:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:47:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:47:28 [DEBUG   ] Finished updating board flags in 1.347 seconds
2013-08-12 23:47:40 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 23:48:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-12 23:48:20 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-08-12 23:48:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:48:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:48:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:48:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:48:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:48:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:48:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:48:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:48:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:48:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:48:29 [DEBUG   ] Finished updating board flags in 2.081 seconds
2013-08-12 23:48:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-12 23:48:59 [DEBUG   ] Got command RPT from MCS: ref #17332
2013-08-12 23:48:59 [DEBUG   ] summary = ERROR
2013-08-12 23:48:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17332  13 56516 85739959 A  ERRORERROR'
2013-08-12 23:48:59 [DEBUG   ] Got command RPT from MCS: ref #17333
2013-08-12 23:48:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 23:48:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17333  77 56516 85739960 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 23:49:01 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-08-12 23:49:21 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-08-12 23:49:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:49:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:49:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:49:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:49:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:49:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:49:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:49:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:49:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:49:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:49:29 [DEBUG   ] Finished updating board flags in 1.989 seconds
2013-08-12 23:49:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-12 23:50:01 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-08-12 23:50:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-12 23:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:50:29 [DEBUG   ] Finished updating board flags in 1.810 seconds
2013-08-12 23:50:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 23:51:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-12 23:51:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-12 23:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:51:29 [DEBUG   ] Finished updating board flags in 1.789 seconds
2013-08-12 23:51:41 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-12 23:52:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-12 23:52:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 23:52:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:52:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:52:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:52:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:52:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:52:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:52:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:52:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:52:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:52:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:52:29 [DEBUG   ] Finished updating board flags in 1.612 seconds
2013-08-12 23:52:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 23:53:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 23:53:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-08-12 23:53:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:53:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:53:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:53:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:53:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:53:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:53:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:53:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:53:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:53:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:53:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-12 23:53:29 [DEBUG   ] Finished updating board flags in 1.591 seconds
2013-08-12 23:53:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-12 23:53:59 [DEBUG   ] Got command RPT from MCS: ref #17349
2013-08-12 23:53:59 [DEBUG   ] summary = ERROR
2013-08-12 23:53:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17349  13 56516 86039967 A  ERRORERROR'
2013-08-12 23:53:59 [DEBUG   ] Got command RPT from MCS: ref #17350
2013-08-12 23:53:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 23:53:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17350  77 56516 86039967 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 23:54:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-12 23:54:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-12 23:54:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:54:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:54:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:54:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:54:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:54:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:54:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:54:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:54:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:54:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:54:29 [DEBUG   ] Finished updating board flags in 1.418 seconds
2013-08-12 23:54:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-08-12 23:55:01 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-12 23:55:22 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-08-12 23:55:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:55:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:55:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:55:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:55:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:55:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:55:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:55:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:55:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:55:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:55:29 [DEBUG   ] Finished updating board flags in 1.390 seconds
2013-08-12 23:55:42 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-12 23:56:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-12 23:56:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-12 23:56:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:56:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:56:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:56:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:56:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:56:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:56:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:56:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:56:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:56:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:56:29 [DEBUG   ] Finished updating board flags in 1.350 seconds
2013-08-12 23:56:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 23:57:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-12 23:57:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-12 23:57:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:57:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:57:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:57:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:57:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:57:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:57:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:57:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:57:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:57:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:57:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-12 23:57:30 [DEBUG   ] Finished updating board flags in 2.070 seconds
2013-08-12 23:57:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-12 23:58:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-12 23:58:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-12 23:58:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:58:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:58:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:58:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:58:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:58:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:58:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:58:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:58:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:58:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:58:30 [DEBUG   ] Finished updating board flags in 1.983 seconds
2013-08-12 23:58:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-12 23:58:59 [DEBUG   ] Got command RPT from MCS: ref #17366
2013-08-12 23:58:59 [DEBUG   ] summary = ERROR
2013-08-12 23:58:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17366  13 56516 86339971 A  ERRORERROR'
2013-08-12 23:58:59 [DEBUG   ] Got command RPT from MCS: ref #17367
2013-08-12 23:58:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-12 23:58:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17367  77 56516 86339971 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-12 23:59:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-12 23:59:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-12 23:59:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-12 23:59:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-12 23:59:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-12 23:59:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-12 23:59:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-12 23:59:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-12 23:59:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-12 23:59:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-12 23:59:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-12 23:59:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-12 23:59:30 [DEBUG   ] Finished updating board flags in 1.821 seconds
2013-08-12 23:59:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-13 00:00:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 00:00:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 00:00:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 00:00:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 00:00:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 00:00:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 00:00:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 00:00:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 00:00:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 00:00:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 00:00:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 00:00:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 00:00:30 [DEBUG   ] Finished updating board flags in 1.783 seconds
2013-08-13 00:00:42 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 00:01:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-08-13 00:01:23 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-08-13 00:01:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 00:01:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 00:01:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 00:01:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 00:01:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 00:01:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 00:01:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 00:01:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 00:01:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 00:01:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 00:01:30 [DEBUG   ] Finished updating board flags in 1.610 seconds
2013-08-13 00:01:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-13 00:02:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-13 00:02:23 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 00:02:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 00:02:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 00:02:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 00:02:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 00:02:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 00:02:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 00:02:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 00:02:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 00:02:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 00:02:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 00:02:30 [DEBUG   ] Finished updating board flags in 1.614 seconds
2013-08-13 00:02:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 00:03:03 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-08-13 00:03:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 00:03:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 00:03:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 00:03:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 00:03:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 00:03:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 00:03:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 00:03:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 00:03:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 00:03:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 00:03:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 00:03:30 [DEBUG   ] Finished updating board flags in 1.587 seconds
2013-08-13 00:03:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 00:03:59 [DEBUG   ] Got command RPT from MCS: ref #17383
2013-08-13 00:03:59 [DEBUG   ] summary = ERROR
2013-08-13 00:03:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17383  13 56517   239971 A  ERRORERROR'
2013-08-13 00:03:59 [DEBUG   ] Got command RPT from MCS: ref #17384
2013-08-13 00:03:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 00:03:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17384  77 56517   239971 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 00:04:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 00:04:23 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-08-13 00:04:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 00:04:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 00:04:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 00:04:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 00:04:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 00:04:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 00:04:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 00:04:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 00:04:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 00:04:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 00:04:30 [DEBUG   ] Finished updating board flags in 1.455 seconds
2013-08-13 00:04:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-08-13 00:05:03 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-08-13 00:05:24 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-08-13 00:05:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 00:05:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 00:05:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 00:05:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 00:05:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 00:05:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 00:05:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 00:05:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 00:05:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 00:05:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 00:05:30 [DEBUG   ] Finished updating board flags in 1.346 seconds
2013-08-13 00:05:44 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-08-13 00:06:04 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-13 00:06:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000076
2013-08-13 00:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000076
2013-08-13 00:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000076
2013-08-13 00:06:30 [DEBUG   ] Finished updating board flags in 1.391 seconds
2013-08-13 00:06:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 00:07:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 00:07:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-13 00:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-13 00:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-13 00:07:31 [DEBUG   ] Finished updating board flags in 2.048 seconds
2013-08-13 00:07:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 00:08:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 00:08:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 00:08:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:08:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:08:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:08:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:08:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:08:31 [DEBUG   ] Finished updating board flags in 1.964 seconds
2013-08-13 00:08:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 00:08:59 [DEBUG   ] Got command RPT from MCS: ref #17400
2013-08-13 00:08:59 [DEBUG   ] summary = ERROR
2013-08-13 00:08:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17400  13 56517   539971 A  ERRORERROR'
2013-08-13 00:08:59 [DEBUG   ] Got command RPT from MCS: ref #17401
2013-08-13 00:08:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 00:08:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17401  77 56517   539971 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 00:09:04 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-08-13 00:09:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-13 00:09:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:09:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:09:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:09:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:09:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:09:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:09:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:09:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:09:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:09:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:09:31 [DEBUG   ] Finished updating board flags in 1.818 seconds
2013-08-13 00:09:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 00:10:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 00:10:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-13 00:10:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:10:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:10:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:10:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:10:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:10:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:10:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:10:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:10:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:10:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:10:31 [DEBUG   ] Finished updating board flags in 1.818 seconds
2013-08-13 00:10:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-08-13 00:11:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-08-13 00:11:25 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-08-13 00:11:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:11:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:11:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:11:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:11:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:11:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:11:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:11:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:11:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:11:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:11:31 [DEBUG   ] Finished updating board flags in 1.817 seconds
2013-08-13 00:11:45 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-13 00:12:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-13 00:12:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-13 00:12:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:12:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:12:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:12:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:12:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:12:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:12:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:12:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:12:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:12:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:12:31 [DEBUG   ] Finished updating board flags in 1.757 seconds
2013-08-13 00:12:45 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 00:13:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 00:13:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 00:13:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:13:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:13:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:13:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:13:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:13:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:13:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:13:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:13:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:13:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:13:31 [DEBUG   ] Finished updating board flags in 1.617 seconds
2013-08-13 00:13:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-13 00:13:59 [DEBUG   ] Got command RPT from MCS: ref #17417
2013-08-13 00:13:59 [DEBUG   ] summary = ERROR
2013-08-13 00:13:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17417  13 56517   839975 A  ERRORERROR'
2013-08-13 00:13:59 [DEBUG   ] Got command RPT from MCS: ref #17418
2013-08-13 00:13:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 00:13:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17418  77 56517   839975 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 00:14:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 00:14:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 00:14:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:14:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:14:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:14:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:14:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:14:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:14:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:14:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:14:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:14:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:14:31 [DEBUG   ] Finished updating board flags in 1.598 seconds
2013-08-13 00:14:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 00:15:05 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-13 00:15:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 00:15:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:15:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:15:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:15:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:15:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:15:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:15:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:15:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:15:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:15:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:15:31 [DEBUG   ] Finished updating board flags in 1.420 seconds
2013-08-13 00:15:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-13 00:16:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 00:16:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 00:16:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:16:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:16:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:16:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:16:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:16:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:16:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:16:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:16:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:16:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:16:31 [DEBUG   ] Finished updating board flags in 1.378 seconds
2013-08-13 00:16:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 00:17:05 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-13 00:17:25 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-13 00:17:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:17:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:17:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:17:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:17:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:17:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2013-08-13 00:17:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:17:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:17:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:17:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:17:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:17:31 [DEBUG   ] Finished updating board flags in 1.362 seconds
2013-08-13 00:17:45 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-13 00:18:06 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-08-13 00:18:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-13 00:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:18:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:18:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:18:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:18:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:18:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:18:32 [DEBUG   ] Finished updating board flags in 2.049 seconds
2013-08-13 00:18:46 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-13 00:18:59 [DEBUG   ] Got command RPT from MCS: ref #17434
2013-08-13 00:18:59 [DEBUG   ] summary = ERROR
2013-08-13 00:18:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17434  13 56517  1139971 A  ERRORERROR'
2013-08-13 00:18:59 [DEBUG   ] Got command RPT from MCS: ref #17435
2013-08-13 00:18:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 00:18:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17435  77 56517  1139971 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 00:19:06 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 00:19:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 00:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:19:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:19:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:19:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:19:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:19:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:19:32 [DEBUG   ] Finished updating board flags in 1.987 seconds
2013-08-13 00:19:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 00:20:06 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-13 00:20:26 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 00:20:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:20:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:20:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:20:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:20:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:20:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:20:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:20:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:20:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:20:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:20:32 [DEBUG   ] Finished updating board flags in 1.861 seconds
2013-08-13 00:20:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 00:21:06 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-08-13 00:21:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 00:21:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:21:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:21:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:21:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:21:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:21:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:21:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:21:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:21:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:21:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:21:32 [DEBUG   ] Finished updating board flags in 1.754 seconds
2013-08-13 00:21:46 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 00:22:06 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-08-13 00:22:26 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-13 00:22:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:22:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:22:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:22:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:22:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:22:32 [DEBUG   ] Finished updating board flags in 1.619 seconds
2013-08-13 00:22:47 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-08-13 00:23:07 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-13 00:23:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-13 00:23:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:23:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:23:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:23:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:23:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:23:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:23:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:23:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:23:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:23:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:23:32 [DEBUG   ] Finished updating board flags in 1.577 seconds
2013-08-13 00:23:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-13 00:23:59 [DEBUG   ] Got command RPT from MCS: ref #17451
2013-08-13 00:23:59 [DEBUG   ] summary = ERROR
2013-08-13 00:23:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17451  13 56517  1439979 A  ERRORERROR'
2013-08-13 00:23:59 [DEBUG   ] Got command RPT from MCS: ref #17452
2013-08-13 00:23:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 00:23:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17452  77 56517  1439979 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 00:24:07 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-08-13 00:24:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 00:24:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:24:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:24:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:24:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:24:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:24:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:24:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:24:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:24:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:24:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:24:32 [DEBUG   ] Finished updating board flags in 1.421 seconds
2013-08-13 00:24:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 00:25:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-13 00:25:27 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-08-13 00:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:25:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:25:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:25:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:25:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:25:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:25:32 [DEBUG   ] Finished updating board flags in 1.391 seconds
2013-08-13 00:25:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 00:26:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 00:26:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 00:26:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:26:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:26:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:26:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:26:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:26:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:26:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:26:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:26:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:26:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:26:32 [DEBUG   ] Finished updating board flags in 1.352 seconds
2013-08-13 00:26:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 00:27:08 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-08-13 00:27:27 [DEBUG   ] Finished updating ant stats in 0.409 seconds
2013-08-13 00:27:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:27:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:27:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:27:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:27:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:27:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:27:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:27:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:27:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:27:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:27:33 [DEBUG   ] Finished updating board flags in 2.061 seconds
2013-08-13 00:27:48 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-08-13 00:28:08 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-13 00:28:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-13 00:28:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:28:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:28:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:28:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:28:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:28:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:28:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:28:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:28:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:28:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:28:33 [DEBUG   ] Finished updating board flags in 1.992 seconds
2013-08-13 00:28:48 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2013-08-13 00:28:59 [DEBUG   ] Got command RPT from MCS: ref #17468
2013-08-13 00:28:59 [DEBUG   ] summary = ERROR
2013-08-13 00:28:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17468  13 56517  1739975 A  ERRORERROR'
2013-08-13 00:28:59 [DEBUG   ] Got command RPT from MCS: ref #17469
2013-08-13 00:28:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 00:28:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17469  77 56517  1739975 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 00:29:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 00:29:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 00:29:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:29:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:29:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:29:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:29:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:29:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:29:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:29:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:29:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:29:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:29:33 [DEBUG   ] Finished updating board flags in 1.808 seconds
2013-08-13 00:29:48 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-13 00:30:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 00:30:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 00:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:30:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:30:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:30:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:30:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:30:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:30:33 [DEBUG   ] Finished updating board flags in 1.789 seconds
2013-08-13 00:30:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 00:31:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 00:31:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 00:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:31:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:31:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:31:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:31:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:31:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:31:33 [DEBUG   ] Finished updating board flags in 1.618 seconds
2013-08-13 00:31:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 00:32:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 00:32:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-13 00:32:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:32:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:32:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:32:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:32:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:32:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:32:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:32:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:32:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:32:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:32:33 [DEBUG   ] Finished updating board flags in 1.585 seconds
2013-08-13 00:32:48 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2013-08-13 00:33:09 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-08-13 00:33:29 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-08-13 00:33:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:33:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:33:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:33:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:33:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:33:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:33:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:33:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:33:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:33:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:33:33 [DEBUG   ] Finished updating board flags in 1.413 seconds
2013-08-13 00:33:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 00:33:59 [DEBUG   ] Got command RPT from MCS: ref #17485
2013-08-13 00:33:59 [DEBUG   ] summary = ERROR
2013-08-13 00:33:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17485  13 56517  2039983 A  ERRORERROR'
2013-08-13 00:33:59 [DEBUG   ] Got command RPT from MCS: ref #17486
2013-08-13 00:33:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 00:33:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17486  77 56517  2039983 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 00:34:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 00:34:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 00:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:34:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:34:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:34:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:34:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:34:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:34:33 [DEBUG   ] Finished updating board flags in 1.389 seconds
2013-08-13 00:34:49 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-13 00:35:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 00:35:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 00:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:35:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:35:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:35:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:35:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:35:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:35:33 [DEBUG   ] Finished updating board flags in 1.362 seconds
2013-08-13 00:35:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 00:36:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 00:36:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 00:36:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:36:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:36:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:36:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:36:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:36:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:36:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:36:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:36:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:36:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:36:34 [DEBUG   ] Finished updating board flags in 2.051 seconds
2013-08-13 00:36:49 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-08-13 00:37:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-13 00:37:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 00:37:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:37:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:37:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:37:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:37:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:37:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:37:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:37:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:37:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:37:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:37:34 [DEBUG   ] Finished updating board flags in 1.990 seconds
2013-08-13 00:37:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 00:38:10 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-08-13 00:38:30 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-08-13 00:38:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:38:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:38:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:38:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:38:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:38:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:38:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:38:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:38:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:38:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:38:34 [DEBUG   ] Finished updating board flags in 1.822 seconds
2013-08-13 00:38:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 00:38:59 [DEBUG   ] Got command RPT from MCS: ref #17502
2013-08-13 00:38:59 [DEBUG   ] summary = ERROR
2013-08-13 00:38:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17502  13 56517  2339979 A  ERRORERROR'
2013-08-13 00:38:59 [DEBUG   ] Got command RPT from MCS: ref #17503
2013-08-13 00:38:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 00:38:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17503  77 56517  2339979 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 00:39:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 00:39:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 00:39:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:39:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:39:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:39:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:39:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:39:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:39:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:39:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:39:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:39:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:39:34 [DEBUG   ] Finished updating board flags in 1.779 seconds
2013-08-13 00:39:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-13 00:40:10 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 00:40:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 00:40:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:40:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:40:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:40:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:40:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:40:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:40:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:40:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:40:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:40:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:40:34 [DEBUG   ] Finished updating board flags in 1.621 seconds
2013-08-13 00:40:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 00:41:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 00:41:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 00:41:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:41:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:41:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:41:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:41:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:41:34 [DEBUG   ] Finished updating board flags in 1.612 seconds
2013-08-13 00:41:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 00:42:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-13 00:42:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 00:42:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:42:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:42:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:42:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:42:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:42:34 [DEBUG   ] Finished updating board flags in 1.585 seconds
2013-08-13 00:42:50 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 00:43:11 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-08-13 00:43:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-13 00:43:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:43:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:43:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:43:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:43:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:43:34 [DEBUG   ] Finished updating board flags in 1.416 seconds
2013-08-13 00:43:50 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-08-13 00:43:59 [DEBUG   ] Got command RPT from MCS: ref #17519
2013-08-13 00:43:59 [DEBUG   ] summary = ERROR
2013-08-13 00:43:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17519  13 56517  2639975 A  ERRORERROR'
2013-08-13 00:43:59 [DEBUG   ] Got command RPT from MCS: ref #17520
2013-08-13 00:43:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 00:43:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17520  77 56517  2639975 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 00:44:11 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-08-13 00:44:31 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-08-13 00:44:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:44:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:44:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:44:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:44:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:44:34 [DEBUG   ] Finished updating board flags in 1.384 seconds
2013-08-13 00:44:51 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2013-08-13 00:45:11 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-08-13 00:45:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 00:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:45:34 [DEBUG   ] Finished updating board flags in 1.365 seconds
2013-08-13 00:45:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 00:46:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 00:46:31 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-08-13 00:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:46:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:46:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:46:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:46:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:46:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:46:35 [DEBUG   ] Finished updating board flags in 2.058 seconds
2013-08-13 00:46:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 00:47:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 00:47:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 00:47:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:47:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:47:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:47:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:47:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:47:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:47:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:47:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:47:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:47:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:47:35 [DEBUG   ] Finished updating board flags in 1.980 seconds
2013-08-13 00:47:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 00:48:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-13 00:48:32 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-08-13 00:48:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:48:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:48:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:48:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:48:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:48:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:48:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:48:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:48:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:48:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:48:35 [DEBUG   ] Finished updating board flags in 1.809 seconds
2013-08-13 00:48:52 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-13 00:48:59 [DEBUG   ] Got command RPT from MCS: ref #17536
2013-08-13 00:48:59 [DEBUG   ] summary = ERROR
2013-08-13 00:48:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17536  13 56517  2939975 A  ERRORERROR'
2013-08-13 00:48:59 [DEBUG   ] Got command RPT from MCS: ref #17537
2013-08-13 00:48:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 00:48:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17537  77 56517  2939975 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 00:49:12 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-13 00:49:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 00:49:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:49:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:49:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:49:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:49:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:49:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:49:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:49:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:49:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:49:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:49:35 [DEBUG   ] Finished updating board flags in 1.804 seconds
2013-08-13 00:49:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 00:50:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 00:50:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 00:50:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:50:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:50:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:50:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:50:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:50:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:50:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:50:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:50:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:50:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:50:35 [DEBUG   ] Finished updating board flags in 1.795 seconds
2013-08-13 00:50:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-13 00:51:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 00:51:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 00:51:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:51:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:51:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:51:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:51:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:51:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:51:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:51:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:51:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:51:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:51:35 [DEBUG   ] Finished updating board flags in 1.615 seconds
2013-08-13 00:51:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 00:52:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 00:52:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 00:52:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:52:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:52:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:52:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:52:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:52:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:52:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:52:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:52:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:52:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:52:35 [DEBUG   ] Finished updating board flags in 1.628 seconds
2013-08-13 00:52:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 00:53:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-13 00:53:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 00:53:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:53:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:53:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:53:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:53:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:53:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:53:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:53:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:53:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:53:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:53:35 [DEBUG   ] Finished updating board flags in 1.570 seconds
2013-08-13 00:53:52 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 00:53:59 [DEBUG   ] Got command RPT from MCS: ref #17553
2013-08-13 00:53:59 [DEBUG   ] summary = ERROR
2013-08-13 00:53:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17553  13 56517  3239979 A  ERRORERROR'
2013-08-13 00:53:59 [DEBUG   ] Got command RPT from MCS: ref #17554
2013-08-13 00:53:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 00:53:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17554  77 56517  3239980 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 00:54:12 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-08-13 00:54:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-13 00:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:54:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:54:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:54:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:54:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:54:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:54:35 [DEBUG   ] Finished updating board flags in 1.406 seconds
2013-08-13 00:54:52 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-08-13 00:55:13 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-08-13 00:55:33 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-08-13 00:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:55:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:55:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:55:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:55:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:55:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:55:35 [DEBUG   ] Finished updating board flags in 1.390 seconds
2013-08-13 00:55:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 00:56:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 00:56:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 00:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:56:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:56:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:56:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:56:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:56:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:56:35 [DEBUG   ] Finished updating board flags in 1.348 seconds
2013-08-13 00:56:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 00:57:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-13 00:57:33 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2013-08-13 00:57:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:57:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:57:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:57:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:57:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:57:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:57:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:57:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:57:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:57:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:57:36 [DEBUG   ] Finished updating board flags in 2.074 seconds
2013-08-13 00:57:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 00:58:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 00:58:33 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-13 00:58:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:58:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:58:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:58:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:58:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:58:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:58:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:58:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:58:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:58:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:58:36 [DEBUG   ] Finished updating board flags in 2.005 seconds
2013-08-13 00:58:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 00:58:59 [DEBUG   ] Got command RPT from MCS: ref #17570
2013-08-13 00:58:59 [DEBUG   ] summary = ERROR
2013-08-13 00:58:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17570  13 56517  3539979 A  ERRORERROR'
2013-08-13 00:58:59 [DEBUG   ] Got command RPT from MCS: ref #17571
2013-08-13 00:58:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 00:58:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17571  77 56517  3539979 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 00:59:13 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-08-13 00:59:34 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-08-13 00:59:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 00:59:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 00:59:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 00:59:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 00:59:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 00:59:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 00:59:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 00:59:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 00:59:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 00:59:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 00:59:36 [DEBUG   ] Finished updating board flags in 1.986 seconds
2013-08-13 00:59:54 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-08-13 01:00:13 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-13 01:00:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-08-13 01:00:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 01:00:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 01:00:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 01:00:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 01:00:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 01:00:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 01:00:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 01:00:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 01:00:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 01:00:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 01:00:36 [DEBUG   ] Finished updating board flags in 1.856 seconds
2013-08-13 01:00:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-13 01:01:13 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-08-13 01:01:34 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-08-13 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 01:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 01:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 01:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 01:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 01:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 01:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 01:01:36 [DEBUG   ] Finished updating board flags in 1.753 seconds
2013-08-13 01:01:54 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-13 01:02:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-13 01:02:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 01:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 01:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 01:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 01:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 01:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 01:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 01:02:36 [DEBUG   ] Finished updating board flags in 1.621 seconds
2013-08-13 01:02:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 01:03:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 01:03:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-13 01:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 01:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 01:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 01:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 01:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 01:03:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 01:03:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 01:03:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 01:03:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 01:03:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 01:03:36 [DEBUG   ] Finished updating board flags in 1.571 seconds
2013-08-13 01:03:54 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2013-08-13 01:03:59 [DEBUG   ] Got command RPT from MCS: ref #17587
2013-08-13 01:03:59 [DEBUG   ] summary = ERROR
2013-08-13 01:03:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17587  13 56517  3839983 A  ERRORERROR'
2013-08-13 01:03:59 [DEBUG   ] Got command RPT from MCS: ref #17588
2013-08-13 01:03:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 01:03:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17588  77 56517  3839983 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 01:04:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 01:04:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 01:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 01:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 01:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 01:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 01:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 01:04:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 01:04:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 01:04:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 01:04:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 01:04:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 01:04:36 [DEBUG   ] Finished updating board flags in 1.423 seconds
2013-08-13 01:04:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 01:05:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 01:05:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-13 01:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 01:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 01:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 01:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 01:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 01:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 01:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 01:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 01:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 01:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 01:05:36 [DEBUG   ] Finished updating board flags in 1.385 seconds
2013-08-13 01:05:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-13 01:06:14 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-13 01:06:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-13 01:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 01:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 01:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 01:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 01:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 01:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 01:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 01:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 01:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 01:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 01:06:36 [DEBUG   ] Finished updating board flags in 1.408 seconds
2013-08-13 01:06:55 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-08-13 01:07:15 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-08-13 01:07:35 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-08-13 01:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999488
2013-08-13 01:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999488
2013-08-13 01:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999488
2013-08-13 01:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999488
2013-08-13 01:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999488
2013-08-13 01:07:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999488
2013-08-13 01:07:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999488
2013-08-13 01:07:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999488
2013-08-13 01:07:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999488
2013-08-13 01:07:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999488
2013-08-13 01:07:36 [DEBUG   ] Finished updating board flags in 1.412 seconds
2013-08-13 01:07:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 01:08:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-13 01:08:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999390
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999390
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999390
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999390
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999390
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-08-13 01:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999390
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999390
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999390
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999390
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999390
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-08-13 01:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-08-13 01:08:37 [DEBUG   ] Finished updating board flags in 2.264 seconds
2013-08-13 01:08:55 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-08-13 01:08:59 [DEBUG   ] Got command RPT from MCS: ref #17604
2013-08-13 01:08:59 [DEBUG   ] summary = ERROR
2013-08-13 01:08:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17604  13 56517  4139983 A  ERRORERROR'
2013-08-13 01:08:59 [DEBUG   ] Got command RPT from MCS: ref #17605
2013-08-13 01:08:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 01:08:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17605  77 56517  4139984 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 01:09:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 01:09:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999390
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999390
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999390
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999390
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999390
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-13 01:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999390
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999390
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999390
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999390
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999390
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-13 01:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-13 01:09:37 [DEBUG   ] Finished updating board flags in 2.127 seconds
2013-08-13 01:09:55 [DEBUG   ] Finished updating ant stats in 0.792 seconds
2013-08-13 01:10:15 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2013-08-13 01:10:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-13 01:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999390
2013-08-13 01:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999390
2013-08-13 01:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999390
2013-08-13 01:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999390
2013-08-13 01:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999390
2013-08-13 01:10:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999390
2013-08-13 01:10:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999390
2013-08-13 01:10:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999390
2013-08-13 01:10:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999390
2013-08-13 01:10:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999390
2013-08-13 01:10:37 [DEBUG   ] Finished updating board flags in 2.007 seconds
2013-08-13 01:10:56 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-08-13 01:11:16 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-08-13 01:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999390
2013-08-13 01:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999390
2013-08-13 01:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999390
2013-08-13 01:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999390
2013-08-13 01:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999390
2013-08-13 01:11:36 [DEBUG   ] Finished updating ant stats in 1.250 seconds
2013-08-13 01:11:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999390
2013-08-13 01:11:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999390
2013-08-13 01:11:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999390
2013-08-13 01:11:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999390
2013-08-13 01:11:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999390
2013-08-13 01:11:37 [DEBUG   ] Finished updating board flags in 1.990 seconds
2013-08-13 01:11:56 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2013-08-13 01:12:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 01:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999390
2013-08-13 01:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999390
2013-08-13 01:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999390
2013-08-13 01:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999390
2013-08-13 01:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999390
2013-08-13 01:12:36 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2013-08-13 01:12:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999390
2013-08-13 01:12:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999390
2013-08-13 01:12:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999390
2013-08-13 01:12:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999390
2013-08-13 01:12:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999390
2013-08-13 01:12:37 [DEBUG   ] Finished updating board flags in 1.822 seconds
2013-08-13 01:12:56 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2013-08-13 01:13:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 01:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999390
2013-08-13 01:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999390
2013-08-13 01:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999390
2013-08-13 01:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999390
2013-08-13 01:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999390
2013-08-13 01:13:36 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2013-08-13 01:13:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999390
2013-08-13 01:13:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999390
2013-08-13 01:13:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999390
2013-08-13 01:13:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999390
2013-08-13 01:13:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999390
2013-08-13 01:13:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-08-13 01:13:37 [CRITICAL] MGT underflow detected on beam(s) 1
2013-08-13 01:13:37 [DEBUG   ] Finished updating board flags in 1.785 seconds
2013-08-13 01:13:56 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2013-08-13 01:13:59 [DEBUG   ] Got command RPT from MCS: ref #17621
2013-08-13 01:13:59 [DEBUG   ] summary = ERROR
2013-08-13 01:13:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17621  13 56517  4439983 A  ERRORERROR'
2013-08-13 01:13:59 [DEBUG   ] Got command RPT from MCS: ref #17622
2013-08-13 01:13:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 01:13:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17622  77 56517  4439984 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 01:14:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-08-13 01:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999390
2013-08-13 01:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999390
2013-08-13 01:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999390
2013-08-13 01:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999390
2013-08-13 01:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999390
2013-08-13 01:14:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999390
2013-08-13 01:14:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999390
2013-08-13 01:14:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999390
2013-08-13 01:14:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999390
2013-08-13 01:14:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999390
2013-08-13 01:14:37 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-08-13 01:14:37 [DEBUG   ] Finished updating board flags in 1.611 seconds
2013-08-13 01:14:57 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-08-13 01:15:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-13 01:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999390
2013-08-13 01:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999390
2013-08-13 01:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999390
2013-08-13 01:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999390
2013-08-13 01:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999390
2013-08-13 01:15:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999390
2013-08-13 01:15:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999390
2013-08-13 01:15:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999390
2013-08-13 01:15:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999390
2013-08-13 01:15:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999390
2013-08-13 01:15:37 [DEBUG   ] Finished updating ant stats in 1.248 seconds
2013-08-13 01:15:37 [DEBUG   ] Finished updating board flags in 1.663 seconds
2013-08-13 01:15:57 [DEBUG   ] Finished updating ant stats in 1.160 seconds
2013-08-13 01:16:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 01:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999390
2013-08-13 01:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999390
2013-08-13 01:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999390
2013-08-13 01:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999390
2013-08-13 01:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999390
2013-08-13 01:16:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999390
2013-08-13 01:16:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999390
2013-08-13 01:16:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999390
2013-08-13 01:16:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999390
2013-08-13 01:16:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999390
2013-08-13 01:16:37 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2013-08-13 01:16:37 [DEBUG   ] Finished updating board flags in 1.586 seconds
2013-08-13 01:16:57 [DEBUG   ] Finished updating ant stats in 0.960 seconds
2013-08-13 01:17:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 01:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999390
2013-08-13 01:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999390
2013-08-13 01:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999390
2013-08-13 01:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999390
2013-08-13 01:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999390
2013-08-13 01:17:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999390
2013-08-13 01:17:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999390
2013-08-13 01:17:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999390
2013-08-13 01:17:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999390
2013-08-13 01:17:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999390
2013-08-13 01:17:37 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2013-08-13 01:17:37 [DEBUG   ] Finished updating board flags in 1.465 seconds
2013-08-13 01:17:57 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2013-08-13 01:18:18 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-08-13 01:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999390
2013-08-13 01:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999390
2013-08-13 01:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999390
2013-08-13 01:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999390
2013-08-13 01:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999390
2013-08-13 01:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999390
2013-08-13 01:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999390
2013-08-13 01:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999390
2013-08-13 01:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999390
2013-08-13 01:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999390
2013-08-13 01:18:37 [DEBUG   ] Finished updating board flags in 1.455 seconds
2013-08-13 01:18:38 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-08-13 01:18:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-13 01:18:59 [DEBUG   ] Got command RPT from MCS: ref #17638
2013-08-13 01:18:59 [DEBUG   ] summary = ERROR
2013-08-13 01:18:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17638  13 56517  4739987 A  ERRORERROR'
2013-08-13 01:18:59 [DEBUG   ] Got command RPT from MCS: ref #17639
2013-08-13 01:18:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 01:18:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17639  77 56517  4739987 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 01:19:18 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999292
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999292
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999292
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999292
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999292
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-08-13 01:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999292
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999292
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999292
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999292
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999292
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-08-13 01:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-08-13 01:19:37 [DEBUG   ] Finished updating board flags in 1.457 seconds
2013-08-13 01:19:38 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 01:19:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 01:20:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999292
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999292
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999292
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999292
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999292
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-13 01:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999292
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999292
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999292
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999292
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999292
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-13 01:20:38 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-13 01:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-13 01:20:38 [DEBUG   ] Finished updating board flags in 2.266 seconds
2013-08-13 01:20:58 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2013-08-13 01:21:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 01:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999292
2013-08-13 01:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999292
2013-08-13 01:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999292
2013-08-13 01:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999292
2013-08-13 01:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999292
2013-08-13 01:21:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999292
2013-08-13 01:21:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999292
2013-08-13 01:21:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999292
2013-08-13 01:21:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999292
2013-08-13 01:21:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999292
2013-08-13 01:21:38 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2013-08-13 01:21:38 [DEBUG   ] Finished updating board flags in 2.168 seconds
2013-08-13 01:21:58 [DEBUG   ] Finished updating ant stats in 0.761 seconds
2013-08-13 01:22:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 01:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999292
2013-08-13 01:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999292
2013-08-13 01:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999292
2013-08-13 01:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999292
2013-08-13 01:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999292
2013-08-13 01:22:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999292
2013-08-13 01:22:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999292
2013-08-13 01:22:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999292
2013-08-13 01:22:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999292
2013-08-13 01:22:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999292
2013-08-13 01:22:38 [DEBUG   ] Finished updating ant stats in 0.446 seconds
2013-08-13 01:22:38 [DEBUG   ] Finished updating board flags in 2.019 seconds
2013-08-13 01:22:59 [DEBUG   ] Finished updating ant stats in 1.360 seconds
2013-08-13 01:23:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-13 01:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999292
2013-08-13 01:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999292
2013-08-13 01:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999292
2013-08-13 01:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999292
2013-08-13 01:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999292
2013-08-13 01:23:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999292
2013-08-13 01:23:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999292
2013-08-13 01:23:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999292
2013-08-13 01:23:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999292
2013-08-13 01:23:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999292
2013-08-13 01:23:38 [DEBUG   ] Finished updating board flags in 1.968 seconds
2013-08-13 01:23:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-13 01:23:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-13 01:23:59 [DEBUG   ] Got command RPT from MCS: ref #17655
2013-08-13 01:23:59 [DEBUG   ] summary = ERROR
2013-08-13 01:23:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17655  13 56517  5039987 A  ERRORERROR'
2013-08-13 01:23:59 [DEBUG   ] Got command RPT from MCS: ref #17656
2013-08-13 01:23:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 01:23:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17656  77 56517  5039988 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 01:24:19 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-13 01:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999292
2013-08-13 01:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999292
2013-08-13 01:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999292
2013-08-13 01:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999292
2013-08-13 01:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999292
2013-08-13 01:24:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999292
2013-08-13 01:24:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999292
2013-08-13 01:24:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999292
2013-08-13 01:24:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999292
2013-08-13 01:24:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999292
2013-08-13 01:24:38 [DEBUG   ] Finished updating board flags in 1.830 seconds
2013-08-13 01:24:39 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-08-13 01:24:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 01:25:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-13 01:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999292
2013-08-13 01:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999292
2013-08-13 01:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999292
2013-08-13 01:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999292
2013-08-13 01:25:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999292
2013-08-13 01:25:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999292
2013-08-13 01:25:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999292
2013-08-13 01:25:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999292
2013-08-13 01:25:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999292
2013-08-13 01:25:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999292
2013-08-13 01:25:38 [DEBUG   ] Finished updating board flags in 1.789 seconds
2013-08-13 01:25:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-13 01:25:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 01:26:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 01:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999292
2013-08-13 01:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999292
2013-08-13 01:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999292
2013-08-13 01:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999292
2013-08-13 01:26:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999292
2013-08-13 01:26:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999292
2013-08-13 01:26:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999292
2013-08-13 01:26:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999292
2013-08-13 01:26:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999292
2013-08-13 01:26:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999292
2013-08-13 01:26:38 [DEBUG   ] Finished updating board flags in 1.612 seconds
2013-08-13 01:26:39 [DEBUG   ] Finished updating ant stats in 0.991 seconds
2013-08-13 01:26:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 01:27:19 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-08-13 01:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999292
2013-08-13 01:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999292
2013-08-13 01:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999292
2013-08-13 01:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999292
2013-08-13 01:27:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999292
2013-08-13 01:27:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999292
2013-08-13 01:27:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999292
2013-08-13 01:27:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999292
2013-08-13 01:27:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999292
2013-08-13 01:27:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999292
2013-08-13 01:27:38 [DEBUG   ] Finished updating board flags in 1.582 seconds
2013-08-13 01:27:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 01:27:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 01:28:19 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 01:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999292
2013-08-13 01:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999292
2013-08-13 01:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999292
2013-08-13 01:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999292
2013-08-13 01:28:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999292
2013-08-13 01:28:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999292
2013-08-13 01:28:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999292
2013-08-13 01:28:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999292
2013-08-13 01:28:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999292
2013-08-13 01:28:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999292
2013-08-13 01:28:38 [DEBUG   ] Finished updating board flags in 1.381 seconds
2013-08-13 01:28:39 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-08-13 01:28:59 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-08-13 01:28:59 [DEBUG   ] Got command RPT from MCS: ref #17672
2013-08-13 01:28:59 [DEBUG   ] summary = ERROR
2013-08-13 01:28:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17672  13 56517  5339991 A  ERRORERROR'
2013-08-13 01:28:59 [DEBUG   ] Got command RPT from MCS: ref #17673
2013-08-13 01:28:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 01:28:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17673  77 56517  5339991 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 01:29:20 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-08-13 01:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999292
2013-08-13 01:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999292
2013-08-13 01:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999292
2013-08-13 01:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999292
2013-08-13 01:29:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999292
2013-08-13 01:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999292
2013-08-13 01:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999292
2013-08-13 01:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999292
2013-08-13 01:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999292
2013-08-13 01:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999292
2013-08-13 01:29:39 [DEBUG   ] Finished updating board flags in 2.245 seconds
2013-08-13 01:29:40 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-08-13 01:30:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-13 01:30:20 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 01:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999292
2013-08-13 01:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999292
2013-08-13 01:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999292
2013-08-13 01:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999292
2013-08-13 01:30:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999292
2013-08-13 01:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999292
2013-08-13 01:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999292
2013-08-13 01:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999292
2013-08-13 01:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999292
2013-08-13 01:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999292
2013-08-13 01:30:39 [DEBUG   ] Finished updating board flags in 2.178 seconds
2013-08-13 01:30:40 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 01:31:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 01:31:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-13 01:31:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999292
2013-08-13 01:31:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999292
2013-08-13 01:31:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999292
2013-08-13 01:31:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999292
2013-08-13 01:31:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999292
2013-08-13 01:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999292
2013-08-13 01:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999292
2013-08-13 01:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999292
2013-08-13 01:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999292
2013-08-13 01:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999292
2013-08-13 01:31:39 [DEBUG   ] Finished updating board flags in 2.024 seconds
2013-08-13 01:31:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 01:32:00 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 01:32:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 01:32:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999292
2013-08-13 01:32:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999292
2013-08-13 01:32:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999292
2013-08-13 01:32:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999292
2013-08-13 01:32:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999292
2013-08-13 01:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999292
2013-08-13 01:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999292
2013-08-13 01:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999292
2013-08-13 01:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999292
2013-08-13 01:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999292
2013-08-13 01:32:39 [DEBUG   ] Finished updating board flags in 1.991 seconds
2013-08-13 01:32:40 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-08-13 01:33:01 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-08-13 01:33:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-13 01:33:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999292
2013-08-13 01:33:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999292
2013-08-13 01:33:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999292
2013-08-13 01:33:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999292
2013-08-13 01:33:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999292
2013-08-13 01:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999292
2013-08-13 01:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999292
2013-08-13 01:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999292
2013-08-13 01:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999292
2013-08-13 01:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999292
2013-08-13 01:33:39 [DEBUG   ] Finished updating board flags in 1.799 seconds
2013-08-13 01:33:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-13 01:33:59 [DEBUG   ] Got command RPT from MCS: ref #17689
2013-08-13 01:33:59 [DEBUG   ] summary = ERROR
2013-08-13 01:33:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17689  13 56517  5639995 A  ERRORERROR'
2013-08-13 01:33:59 [DEBUG   ] Got command RPT from MCS: ref #17690
2013-08-13 01:33:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 01:33:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17690  77 56517  5639995 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 01:34:01 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 01:34:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 01:34:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999292
2013-08-13 01:34:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999292
2013-08-13 01:34:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999292
2013-08-13 01:34:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999292
2013-08-13 01:34:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999292
2013-08-13 01:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999292
2013-08-13 01:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999292
2013-08-13 01:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999292
2013-08-13 01:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999292
2013-08-13 01:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999292
2013-08-13 01:34:39 [DEBUG   ] Finished updating board flags in 1.573 seconds
2013-08-13 01:34:41 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-08-13 01:35:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-13 01:35:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-08-13 01:35:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-08-13 01:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-08-13 01:35:39 [DEBUG   ] Finished updating board flags in 1.430 seconds
2013-08-13 01:35:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 01:36:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 01:36:21 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-13 01:36:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-13 01:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-13 01:36:39 [DEBUG   ] Finished updating board flags in 1.422 seconds
2013-08-13 01:36:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 01:37:01 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 01:37:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 01:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 01:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 01:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 01:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 01:37:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 01:37:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 01:37:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 01:37:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 01:37:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 01:37:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 01:37:39 [DEBUG   ] Finished updating board flags in 1.430 seconds
2013-08-13 01:37:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 01:38:01 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2013-08-13 01:38:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-13 01:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 01:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 01:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 01:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 01:38:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 01:38:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 01:38:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 01:38:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 01:38:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 01:38:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 01:38:39 [DEBUG   ] Finished updating board flags in 1.433 seconds
2013-08-13 01:38:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-13 01:38:59 [DEBUG   ] Got command RPT from MCS: ref #17706
2013-08-13 01:38:59 [DEBUG   ] summary = ERROR
2013-08-13 01:38:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17706  13 56517  5939991 A  ERRORERROR'
2013-08-13 01:38:59 [DEBUG   ] Got command RPT from MCS: ref #17707
2013-08-13 01:38:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 01:38:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17707  77 56517  5939991 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 01:39:01 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2013-08-13 01:39:21 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-08-13 01:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 01:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 01:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 01:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 01:39:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 01:39:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 01:39:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 01:39:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 01:39:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 01:39:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 01:39:39 [DEBUG   ] Finished updating board flags in 1.433 seconds
2013-08-13 01:39:42 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-08-13 01:40:02 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-13 01:40:22 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-13 01:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 01:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 01:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 01:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 01:40:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 01:40:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 01:40:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 01:40:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 01:40:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 01:40:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 01:40:39 [DEBUG   ] Finished updating board flags in 1.433 seconds
2013-08-13 01:40:42 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 01:41:02 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-08-13 01:41:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 01:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 01:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 01:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 01:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 01:41:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 01:41:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 01:41:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 01:41:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 01:41:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 01:41:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 01:41:39 [DEBUG   ] Finished updating board flags in 1.433 seconds
2013-08-13 01:41:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 01:42:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 01:42:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 01:42:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 01:42:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 01:42:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 01:42:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 01:42:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 01:42:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 01:42:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 01:42:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 01:42:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 01:42:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 01:42:40 [DEBUG   ] Finished updating board flags in 2.242 seconds
2013-08-13 01:42:43 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-08-13 01:43:03 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-08-13 01:43:23 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-13 01:43:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 01:43:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 01:43:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 01:43:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 01:43:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 01:43:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 01:43:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 01:43:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 01:43:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 01:43:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 01:43:40 [DEBUG   ] Finished updating board flags in 2.141 seconds
2013-08-13 01:43:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-13 01:43:59 [DEBUG   ] Got command RPT from MCS: ref #17723
2013-08-13 01:43:59 [DEBUG   ] summary = ERROR
2013-08-13 01:43:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17723  13 56517  6239995 A  ERRORERROR'
2013-08-13 01:43:59 [DEBUG   ] Got command RPT from MCS: ref #17724
2013-08-13 01:43:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 01:43:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17724  77 56517  6239995 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 01:44:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 01:44:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 01:44:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 01:44:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 01:44:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 01:44:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 01:44:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 01:44:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 01:44:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 01:44:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 01:44:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 01:44:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 01:44:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-13 01:44:40 [DEBUG   ] Finished updating board flags in 2.012 seconds
2013-08-13 01:44:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 01:45:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-13 01:45:23 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 01:45:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 01:45:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 01:45:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 01:45:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 01:45:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 01:45:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 01:45:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 01:45:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 01:45:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 01:45:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 01:45:40 [DEBUG   ] Finished updating board flags in 2.008 seconds
2013-08-13 01:45:43 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2013-08-13 01:46:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 01:46:23 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-13 01:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 01:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 01:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 01:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 01:46:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 01:46:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 01:46:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 01:46:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 01:46:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 01:46:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 01:46:40 [DEBUG   ] Finished updating board flags in 1.991 seconds
2013-08-13 01:46:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 01:47:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 01:47:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 01:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 01:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 01:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 01:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 01:47:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 01:47:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 01:47:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 01:47:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 01:47:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 01:47:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 01:47:40 [DEBUG   ] Finished updating board flags in 1.812 seconds
2013-08-13 01:47:43 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-13 01:48:03 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-13 01:48:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 01:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 01:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 01:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 01:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 01:48:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 01:48:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 01:48:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 01:48:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 01:48:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 01:48:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 01:48:40 [DEBUG   ] Finished updating board flags in 1.827 seconds
2013-08-13 01:48:44 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-08-13 01:48:59 [DEBUG   ] Got command RPT from MCS: ref #17740
2013-08-13 01:48:59 [DEBUG   ] summary = ERROR
2013-08-13 01:48:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17740  13 56517  6539991 A  ERRORERROR'
2013-08-13 01:48:59 [DEBUG   ] Got command RPT from MCS: ref #17741
2013-08-13 01:48:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 01:48:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17741  77 56517  6539991 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 01:49:03 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-08-13 01:49:23 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-08-13 01:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 01:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 01:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 01:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 01:49:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 01:49:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 01:49:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 01:49:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 01:49:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 01:49:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 01:49:40 [DEBUG   ] Finished updating board flags in 1.815 seconds
2013-08-13 01:49:44 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2013-08-13 01:50:04 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2013-08-13 01:50:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 01:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 01:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 01:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 01:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 01:50:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 01:50:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 01:50:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 01:50:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 01:50:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 01:50:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 01:50:40 [DEBUG   ] Finished updating board flags in 1.750 seconds
2013-08-13 01:50:44 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 01:51:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-13 01:51:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 01:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 01:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 01:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 01:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 01:51:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 01:51:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 01:51:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 01:51:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 01:51:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 01:51:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 01:51:40 [DEBUG   ] Finished updating board flags in 1.616 seconds
2013-08-13 01:51:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 01:52:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 01:52:24 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-13 01:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 01:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 01:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 01:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 01:52:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 01:52:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 01:52:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 01:52:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 01:52:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 01:52:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 01:52:40 [DEBUG   ] Finished updating board flags in 1.593 seconds
2013-08-13 01:52:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-13 01:53:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 01:53:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-13 01:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 01:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 01:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 01:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 01:53:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 01:53:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 01:53:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 01:53:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 01:53:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 01:53:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 01:53:40 [DEBUG   ] Finished updating board flags in 1.399 seconds
2013-08-13 01:53:45 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2013-08-13 01:54:00 [DEBUG   ] Got command RPT from MCS: ref #17757
2013-08-13 01:54:00 [DEBUG   ] summary = ERROR
2013-08-13 01:54:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17757  13 56517  6840003 A  ERRORERROR'
2013-08-13 01:54:00 [DEBUG   ] Got command RPT from MCS: ref #17758
2013-08-13 01:54:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 01:54:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17758  77 56517  6840003 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 01:54:04 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-13 01:54:24 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-08-13 01:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 01:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 01:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 01:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 01:54:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 01:54:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 01:54:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 01:54:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 01:54:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 01:54:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 01:54:40 [DEBUG   ] Finished updating board flags in 1.368 seconds
2013-08-13 01:54:45 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-08-13 01:55:05 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-08-13 01:55:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 01:55:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 01:55:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 01:55:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 01:55:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 01:55:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 01:55:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 01:55:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 01:55:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 01:55:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 01:55:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 01:55:41 [DEBUG   ] Finished updating board flags in 2.062 seconds
2013-08-13 01:55:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 01:56:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 01:56:25 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2013-08-13 01:56:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 01:56:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 01:56:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 01:56:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 01:56:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 01:56:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 01:56:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 01:56:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 01:56:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 01:56:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 01:56:41 [DEBUG   ] Finished updating board flags in 1.978 seconds
2013-08-13 01:56:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 01:57:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 01:57:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 01:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 01:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 01:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 01:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 01:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 01:57:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 01:57:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 01:57:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 01:57:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 01:57:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 01:57:41 [DEBUG   ] Finished updating board flags in 1.806 seconds
2013-08-13 01:57:45 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2013-08-13 01:58:06 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-08-13 01:58:26 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-08-13 01:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 01:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 01:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 01:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 01:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 01:58:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 01:58:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 01:58:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 01:58:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 01:58:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 01:58:41 [DEBUG   ] Finished updating board flags in 1.792 seconds
2013-08-13 01:58:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 01:58:59 [DEBUG   ] Got command RPT from MCS: ref #17774
2013-08-13 01:58:59 [DEBUG   ] summary = ERROR
2013-08-13 01:58:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17774  13 56517  7139995 A  ERRORERROR'
2013-08-13 01:58:59 [DEBUG   ] Got command RPT from MCS: ref #17775
2013-08-13 01:58:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 01:58:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17775  77 56517  7139995 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 01:59:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 01:59:26 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 01:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 01:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 01:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 01:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 01:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 01:59:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 01:59:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 01:59:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 01:59:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 01:59:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 01:59:41 [DEBUG   ] Finished updating board flags in 1.610 seconds
2013-08-13 01:59:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 02:00:06 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-13 02:00:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 02:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:00:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:00:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:00:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:00:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:00:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:00:41 [DEBUG   ] Finished updating board flags in 1.594 seconds
2013-08-13 02:00:46 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2013-08-13 02:01:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 02:01:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 02:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:01:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:01:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:01:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:01:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:01:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:01:41 [DEBUG   ] Finished updating board flags in 1.423 seconds
2013-08-13 02:01:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-13 02:02:06 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 02:02:27 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-08-13 02:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:02:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:02:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:02:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:02:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:02:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:02:41 [DEBUG   ] Finished updating board flags in 1.388 seconds
2013-08-13 02:02:47 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-08-13 02:03:07 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-08-13 02:03:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-13 02:03:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:03:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:03:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:03:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:03:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:03:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:03:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:03:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:03:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:03:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:03:42 [DEBUG   ] Finished updating board flags in 2.203 seconds
2013-08-13 02:03:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 02:03:59 [DEBUG   ] Got command RPT from MCS: ref #17791
2013-08-13 02:03:59 [DEBUG   ] summary = ERROR
2013-08-13 02:03:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17791  13 56517  7439995 A  ERRORERROR'
2013-08-13 02:03:59 [DEBUG   ] Got command RPT from MCS: ref #17792
2013-08-13 02:03:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 02:03:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17792  77 56517  7439996 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 02:04:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 02:04:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-13 02:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:04:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:04:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:04:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:04:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:04:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:04:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:04:41 [DEBUG   ] Finished updating board flags in 1.324 seconds
2013-08-13 02:04:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 02:05:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 02:05:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 02:05:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:05:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:05:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:05:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:05:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:05:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:05:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:05:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:05:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:05:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:05:42 [DEBUG   ] Finished updating board flags in 2.146 seconds
2013-08-13 02:05:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 02:06:07 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-13 02:06:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 02:06:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:06:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:06:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:06:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:06:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:06:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-08-13 02:06:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:06:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:06:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:06:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:06:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:06:42 [DEBUG   ] Finished updating board flags in 1.993 seconds
2013-08-13 02:06:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 02:07:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 02:07:27 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-13 02:07:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:07:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:07:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:07:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:07:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:07:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:07:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:07:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:07:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:07:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:07:42 [DEBUG   ] Finished updating board flags in 1.740 seconds
2013-08-13 02:07:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 02:08:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 02:08:27 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-08-13 02:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:08:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:08:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:08:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:08:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:08:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:08:42 [DEBUG   ] Finished updating board flags in 1.611 seconds
2013-08-13 02:08:48 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-08-13 02:08:59 [DEBUG   ] Got command RPT from MCS: ref #17808
2013-08-13 02:08:59 [DEBUG   ] summary = ERROR
2013-08-13 02:08:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17808  13 56517  7739999 A  ERRORERROR'
2013-08-13 02:08:59 [DEBUG   ] Got command RPT from MCS: ref #17809
2013-08-13 02:08:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 02:08:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17809  77 56517  7739999 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 02:09:08 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-13 02:09:28 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-13 02:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:09:42 [DEBUG   ] Finished updating board flags in 1.583 seconds
2013-08-13 02:09:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 02:10:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 02:10:28 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2013-08-13 02:10:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:10:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:10:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:10:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:10:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:10:42 [DEBUG   ] Finished updating board flags in 1.423 seconds
2013-08-13 02:10:48 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2013-08-13 02:11:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 02:11:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 02:11:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:11:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:11:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:11:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:11:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:11:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:11:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:11:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:11:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:11:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:11:42 [DEBUG   ] Finished updating board flags in 1.383 seconds
2013-08-13 02:11:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 02:12:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 02:12:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 02:12:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:12:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:12:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:12:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:12:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:12:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-08-13 02:12:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:12:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:12:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:12:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:12:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:12:42 [DEBUG   ] Finished updating board flags in 1.384 seconds
2013-08-13 02:12:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 02:13:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 02:13:29 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-08-13 02:13:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:13:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:13:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:13:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:13:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:13:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:13:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:13:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:13:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:13:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:13:43 [DEBUG   ] Finished updating board flags in 2.036 seconds
2013-08-13 02:13:49 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-08-13 02:14:00 [DEBUG   ] Got command RPT from MCS: ref #17825
2013-08-13 02:14:00 [DEBUG   ] summary = ERROR
2013-08-13 02:14:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17825  13 56517  8040024 A  ERRORERROR'
2013-08-13 02:14:00 [DEBUG   ] Got command RPT from MCS: ref #17826
2013-08-13 02:14:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 02:14:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17826  77 56517  8040024 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 02:14:09 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-13 02:14:29 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-13 02:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:14:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:14:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:14:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:14:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:14:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:14:43 [DEBUG   ] Finished updating board flags in 1.983 seconds
2013-08-13 02:14:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-13 02:15:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 02:15:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 02:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:15:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:15:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:15:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:15:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:15:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:15:43 [DEBUG   ] Finished updating board flags in 1.823 seconds
2013-08-13 02:15:49 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-13 02:16:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 02:16:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 02:16:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:16:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:16:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:16:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:16:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:16:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:16:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:16:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:16:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:16:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:16:43 [DEBUG   ] Finished updating board flags in 1.782 seconds
2013-08-13 02:16:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 02:17:09 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2013-08-13 02:17:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 02:17:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:17:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:17:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:17:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:17:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:17:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:17:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:17:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:17:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:17:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:17:43 [DEBUG   ] Finished updating board flags in 1.615 seconds
2013-08-13 02:17:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 02:18:09 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 02:18:29 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-13 02:18:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:18:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:18:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:18:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:18:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:18:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:18:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:18:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:18:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:18:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:18:43 [DEBUG   ] Finished updating board flags in 1.607 seconds
2013-08-13 02:18:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 02:18:59 [DEBUG   ] Got command RPT from MCS: ref #17842
2013-08-13 02:19:00 [DEBUG   ] summary = ERROR
2013-08-13 02:19:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17842  13 56517  8340020 A  ERRORERROR'
2013-08-13 02:19:00 [DEBUG   ] Got command RPT from MCS: ref #17843
2013-08-13 02:19:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 02:19:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17843  77 56517  8340021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 02:19:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-13 02:19:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-13 02:19:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:19:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:19:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:19:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:19:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:19:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:19:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:19:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:19:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:19:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:19:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-13 02:19:43 [DEBUG   ] Finished updating board flags in 1.632 seconds
2013-08-13 02:19:49 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-13 02:20:10 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-08-13 02:20:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-13 02:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:20:43 [DEBUG   ] Finished updating board flags in 1.610 seconds
2013-08-13 02:20:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-13 02:21:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-13 02:21:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 02:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:21:43 [DEBUG   ] Finished updating board flags in 1.553 seconds
2013-08-13 02:21:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 02:22:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-13 02:22:30 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2013-08-13 02:22:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:22:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:22:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:22:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:22:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:22:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:22:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:22:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:22:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:22:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:22:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-13 02:22:43 [DEBUG   ] Finished updating board flags in 1.410 seconds
2013-08-13 02:22:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 02:23:10 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 02:23:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 02:23:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:23:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:23:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:23:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:23:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:23:43 [DEBUG   ] Finished updating board flags in 1.407 seconds
2013-08-13 02:23:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 02:23:59 [DEBUG   ] Got command RPT from MCS: ref #17859
2013-08-13 02:23:59 [DEBUG   ] summary = ERROR
2013-08-13 02:23:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17859  13 56517  8639999 A  ERRORERROR'
2013-08-13 02:23:59 [DEBUG   ] Got command RPT from MCS: ref #17860
2013-08-13 02:23:59 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 02:24:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17860  77 56517  8639999 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 02:24:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 02:24:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 02:24:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:24:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:24:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:24:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:24:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:24:43 [DEBUG   ] Finished updating board flags in 1.393 seconds
2013-08-13 02:24:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 02:25:10 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-08-13 02:25:31 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-08-13 02:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:25:43 [DEBUG   ] Finished updating board flags in 1.382 seconds
2013-08-13 02:25:51 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-13 02:26:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-13 02:26:31 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 02:26:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:26:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:26:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:26:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:26:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:26:44 [DEBUG   ] Finished updating board flags in 2.033 seconds
2013-08-13 02:26:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-13 02:27:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 02:27:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 02:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:27:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-13 02:27:44 [DEBUG   ] Finished updating board flags in 1.985 seconds
2013-08-13 02:27:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 02:28:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 02:28:31 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-13 02:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:28:44 [DEBUG   ] Finished updating board flags in 1.812 seconds
2013-08-13 02:28:51 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 02:29:00 [DEBUG   ] Got command RPT from MCS: ref #17876
2013-08-13 02:29:00 [DEBUG   ] summary = ERROR
2013-08-13 02:29:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17876  13 56517  8940011 A  ERRORERROR'
2013-08-13 02:29:00 [DEBUG   ] Got command RPT from MCS: ref #17877
2013-08-13 02:29:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 02:29:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17877  77 56517  8940011 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 02:29:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 02:29:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 02:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999194
2013-08-13 02:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999194
2013-08-13 02:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999194
2013-08-13 02:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999194
2013-08-13 02:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999194
2013-08-13 02:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999194
2013-08-13 02:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999194
2013-08-13 02:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999194
2013-08-13 02:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999194
2013-08-13 02:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999194
2013-08-13 02:29:44 [DEBUG   ] Finished updating board flags in 1.804 seconds
2013-08-13 02:29:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 02:30:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 02:30:31 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999096
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999096
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999096
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999096
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999096
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-08-13 02:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999096
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999096
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999096
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999096
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999096
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-08-13 02:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-08-13 02:30:44 [DEBUG   ] Finished updating board flags in 1.814 seconds
2013-08-13 02:30:51 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-08-13 02:31:11 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-08-13 02:31:32 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999096
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999096
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999096
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999096
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999096
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-13 02:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999096
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999096
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999096
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999096
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999096
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-13 02:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-13 02:31:44 [DEBUG   ] Finished updating board flags in 1.811 seconds
2013-08-13 02:31:52 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-08-13 02:32:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 02:32:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 02:32:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999096
2013-08-13 02:32:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999096
2013-08-13 02:32:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999096
2013-08-13 02:32:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999096
2013-08-13 02:32:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999096
2013-08-13 02:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999096
2013-08-13 02:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999096
2013-08-13 02:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999096
2013-08-13 02:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999096
2013-08-13 02:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999096
2013-08-13 02:32:44 [DEBUG   ] Finished updating board flags in 1.766 seconds
2013-08-13 02:32:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 02:33:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 02:33:32 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2013-08-13 02:33:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999096
2013-08-13 02:33:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999096
2013-08-13 02:33:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999096
2013-08-13 02:33:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999096
2013-08-13 02:33:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999096
2013-08-13 02:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999096
2013-08-13 02:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999096
2013-08-13 02:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999096
2013-08-13 02:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999096
2013-08-13 02:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999096
2013-08-13 02:33:44 [DEBUG   ] Finished updating board flags in 1.620 seconds
2013-08-13 02:33:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 02:34:00 [DEBUG   ] Got command RPT from MCS: ref #17893
2013-08-13 02:34:00 [DEBUG   ] summary = ERROR
2013-08-13 02:34:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17893  13 56517  9240011 A  ERRORERROR'
2013-08-13 02:34:00 [DEBUG   ] Got command RPT from MCS: ref #17894
2013-08-13 02:34:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 02:34:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17894  77 56517  9240011 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 02:34:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 02:34:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 02:34:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999096
2013-08-13 02:34:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999096
2013-08-13 02:34:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999096
2013-08-13 02:34:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999096
2013-08-13 02:34:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999096
2013-08-13 02:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999096
2013-08-13 02:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999096
2013-08-13 02:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999096
2013-08-13 02:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999096
2013-08-13 02:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999096
2013-08-13 02:34:44 [DEBUG   ] Finished updating board flags in 1.587 seconds
2013-08-13 02:34:52 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2013-08-13 02:35:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 02:35:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 02:35:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999096
2013-08-13 02:35:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999096
2013-08-13 02:35:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999096
2013-08-13 02:35:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999096
2013-08-13 02:35:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999096
2013-08-13 02:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999096
2013-08-13 02:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999096
2013-08-13 02:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999096
2013-08-13 02:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999096
2013-08-13 02:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999096
2013-08-13 02:35:44 [DEBUG   ] Finished updating board flags in 1.499 seconds
2013-08-13 02:35:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 02:36:12 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2013-08-13 02:36:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-13 02:36:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999096
2013-08-13 02:36:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999096
2013-08-13 02:36:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999096
2013-08-13 02:36:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999096
2013-08-13 02:36:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999096
2013-08-13 02:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999096
2013-08-13 02:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999096
2013-08-13 02:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999096
2013-08-13 02:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999096
2013-08-13 02:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999096
2013-08-13 02:36:44 [DEBUG   ] Finished updating board flags in 1.501 seconds
2013-08-13 02:36:52 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2013-08-13 02:37:13 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-13 02:37:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 02:37:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999096
2013-08-13 02:37:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999096
2013-08-13 02:37:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999096
2013-08-13 02:37:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999096
2013-08-13 02:37:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999096
2013-08-13 02:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999096
2013-08-13 02:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999096
2013-08-13 02:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999096
2013-08-13 02:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999096
2013-08-13 02:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999096
2013-08-13 02:37:44 [DEBUG   ] Finished updating board flags in 1.505 seconds
2013-08-13 02:37:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 02:38:13 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2013-08-13 02:38:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 02:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999096
2013-08-13 02:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999096
2013-08-13 02:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999096
2013-08-13 02:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999096
2013-08-13 02:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999096
2013-08-13 02:38:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999096
2013-08-13 02:38:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999096
2013-08-13 02:38:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999096
2013-08-13 02:38:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999096
2013-08-13 02:38:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999096
2013-08-13 02:38:45 [DEBUG   ] Finished updating board flags in 2.196 seconds
2013-08-13 02:38:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 02:39:00 [DEBUG   ] Got command RPT from MCS: ref #17910
2013-08-13 02:39:00 [DEBUG   ] summary = ERROR
2013-08-13 02:39:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17910  13 56517  9540015 A  ERRORERROR'
2013-08-13 02:39:00 [DEBUG   ] Got command RPT from MCS: ref #17911
2013-08-13 02:39:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 02:39:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17911  77 56517  9540015 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 02:39:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 02:39:33 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-13 02:39:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999096
2013-08-13 02:39:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999096
2013-08-13 02:39:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999096
2013-08-13 02:39:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999096
2013-08-13 02:39:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999096
2013-08-13 02:39:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999096
2013-08-13 02:39:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999096
2013-08-13 02:39:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999096
2013-08-13 02:39:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999096
2013-08-13 02:39:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999096
2013-08-13 02:39:45 [DEBUG   ] Finished updating board flags in 1.928 seconds
2013-08-13 02:39:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 02:40:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 02:40:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 02:40:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999096
2013-08-13 02:40:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999096
2013-08-13 02:40:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999096
2013-08-13 02:40:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999096
2013-08-13 02:40:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999096
2013-08-13 02:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999096
2013-08-13 02:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999096
2013-08-13 02:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999096
2013-08-13 02:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999096
2013-08-13 02:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999096
2013-08-13 02:40:45 [DEBUG   ] Finished updating board flags in 1.786 seconds
2013-08-13 02:40:54 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-08-13 02:41:13 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2013-08-13 02:41:33 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-08-13 02:41:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999096
2013-08-13 02:41:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999096
2013-08-13 02:41:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999096
2013-08-13 02:41:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999096
2013-08-13 02:41:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999096
2013-08-13 02:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999096
2013-08-13 02:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999096
2013-08-13 02:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999096
2013-08-13 02:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999096
2013-08-13 02:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999096
2013-08-13 02:41:45 [DEBUG   ] Finished updating board flags in 1.615 seconds
2013-08-13 02:41:54 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2013-08-13 02:42:14 [DEBUG   ] Finished updating ant stats in 1.193 seconds
2013-08-13 02:42:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 02:42:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999096
2013-08-13 02:42:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999096
2013-08-13 02:42:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999096
2013-08-13 02:42:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999096
2013-08-13 02:42:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999096
2013-08-13 02:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999096
2013-08-13 02:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999096
2013-08-13 02:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999096
2013-08-13 02:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999096
2013-08-13 02:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999096
2013-08-13 02:42:45 [DEBUG   ] Finished updating board flags in 1.575 seconds
2013-08-13 02:42:54 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 02:43:14 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-13 02:43:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 02:43:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999096
2013-08-13 02:43:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999096
2013-08-13 02:43:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999096
2013-08-13 02:43:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999096
2013-08-13 02:43:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999096
2013-08-13 02:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999096
2013-08-13 02:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999096
2013-08-13 02:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999096
2013-08-13 02:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999096
2013-08-13 02:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999096
2013-08-13 02:43:45 [DEBUG   ] Finished updating board flags in 1.424 seconds
2013-08-13 02:43:54 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 02:44:00 [DEBUG   ] Got command RPT from MCS: ref #17927
2013-08-13 02:44:00 [DEBUG   ] summary = ERROR
2013-08-13 02:44:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17927  13 56517  9840007 A  ERRORERROR'
2013-08-13 02:44:00 [DEBUG   ] Got command RPT from MCS: ref #17928
2013-08-13 02:44:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 02:44:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17928  77 56517  9840007 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 02:44:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 02:44:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 02:44:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999096
2013-08-13 02:44:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999096
2013-08-13 02:44:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999096
2013-08-13 02:44:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999096
2013-08-13 02:44:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999096
2013-08-13 02:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999096
2013-08-13 02:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999096
2013-08-13 02:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999096
2013-08-13 02:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999096
2013-08-13 02:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999096
2013-08-13 02:44:45 [DEBUG   ] Finished updating board flags in 1.389 seconds
2013-08-13 02:44:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-13 02:45:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-13 02:45:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 02:45:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999096
2013-08-13 02:45:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999096
2013-08-13 02:45:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999096
2013-08-13 02:45:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999096
2013-08-13 02:45:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999096
2013-08-13 02:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999096
2013-08-13 02:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999096
2013-08-13 02:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999096
2013-08-13 02:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999096
2013-08-13 02:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999096
2013-08-13 02:45:45 [DEBUG   ] Finished updating board flags in 1.378 seconds
2013-08-13 02:45:55 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-08-13 02:46:14 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2013-08-13 02:46:34 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-08-13 02:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999096
2013-08-13 02:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999096
2013-08-13 02:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999096
2013-08-13 02:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999096
2013-08-13 02:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999096
2013-08-13 02:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999096
2013-08-13 02:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999096
2013-08-13 02:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999096
2013-08-13 02:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999096
2013-08-13 02:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999096
2013-08-13 02:46:46 [DEBUG   ] Finished updating board flags in 2.046 seconds
2013-08-13 02:46:55 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-08-13 02:47:15 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-08-13 02:47:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 02:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999096
2013-08-13 02:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999096
2013-08-13 02:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999096
2013-08-13 02:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999096
2013-08-13 02:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999096
2013-08-13 02:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999096
2013-08-13 02:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999096
2013-08-13 02:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999096
2013-08-13 02:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999096
2013-08-13 02:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999096
2013-08-13 02:47:46 [DEBUG   ] Finished updating board flags in 1.983 seconds
2013-08-13 02:47:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 02:48:15 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-13 02:48:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 02:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999096
2013-08-13 02:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999096
2013-08-13 02:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999096
2013-08-13 02:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999096
2013-08-13 02:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999096
2013-08-13 02:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999096
2013-08-13 02:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999096
2013-08-13 02:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999096
2013-08-13 02:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999096
2013-08-13 02:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999096
2013-08-13 02:48:46 [DEBUG   ] Finished updating board flags in 1.826 seconds
2013-08-13 02:48:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 02:49:00 [DEBUG   ] Got command RPT from MCS: ref #17944
2013-08-13 02:49:00 [DEBUG   ] summary = ERROR
2013-08-13 02:49:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17944  13 56517 10140011 A  ERRORERROR'
2013-08-13 02:49:00 [DEBUG   ] Got command RPT from MCS: ref #17945
2013-08-13 02:49:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-08-13 02:49:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17945  77 56517 10140011 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-08-13 02:49:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-13 02:49:35 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-13 02:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999096
2013-08-13 02:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999096
2013-08-13 02:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999096
2013-08-13 02:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999096
2013-08-13 02:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999096
2013-08-13 02:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999096
2013-08-13 02:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999096
2013-08-13 02:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999096
2013-08-13 02:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999096
2013-08-13 02:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999096
2013-08-13 02:49:46 [DEBUG   ] Finished updating board flags in 1.777 seconds
2013-08-13 02:49:56 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-08-13 02:50:00 [DEBUG   ] Got command INI from MCS: ref #17961
2013-08-13 02:50:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2013-08-13 02:50:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    17961   8 56517 10200499 ABOOTING'
2013-08-13 02:50:24 [INFO    ] -------------------
2013-08-13 02:50:24 [INFO    ]  LWA board status
2013-08-13 02:50:24 [INFO    ] -------------------
2013-08-13 02:50:24 [INFO    ] DP 1: 2 lwa27
2013-08-13 02:50:24 [INFO    ] DP 1: 3 lwa24
2013-08-13 02:50:24 [INFO    ] DP 1: 4 lwa23
2013-08-13 02:50:24 [INFO    ] DP 1: 5 lwa18
2013-08-13 02:50:24 [INFO    ] DP 1: 6 lwa10
2013-08-13 02:50:24 [INFO    ] DP 1: 7 lwa32
2013-08-13 02:50:24 [INFO    ] DP 1: 8 lwa11
2013-08-13 02:50:24 [INFO    ] DP 1: 9 lwa30
2013-08-13 02:50:24 [INFO    ] DP 1: 10 lwa12
2013-08-13 02:50:24 [INFO    ] DP 1: 11 lwa8
2013-08-13 02:50:24 [INFO    ] DP 1: 12 lwa13
2013-08-13 02:50:24 [INFO    ] DP 1: 13 lwa26
2013-08-13 02:50:24 [INFO    ] DP 1: 14 lwa14
2013-08-13 02:50:24 [INFO    ] DP 1: 16 lwa22
2013-08-13 02:50:24 [INFO    ] DP 1: 17 lwa20
2013-08-13 02:50:24 [INFO    ] DP 1: 18 lwa1
2013-08-13 02:50:24 [INFO    ] DP 1: 19 lwa5
2013-08-13 02:50:24 [INFO    ] DP 1: 20 lwa25
2013-08-13 02:50:24 [INFO    ] DP 1: 21 lwa35
2013-08-13 02:50:24 [INFO    ] DP 1: 22 lwa19
2013-08-13 02:50:24 [INFO    ] DP 1: 23 lwa21
2013-08-13 02:50:24 [INFO    ] DP 1: 24 lwa6
2013-08-13 02:50:24 [INFO    ] DP 1: 25 lwa7
2013-08-13 02:50:24 [INFO    ] DP 1: 26 lwa33
2013-08-13 02:50:24 [INFO    ] DP 1: 27 lwa15
2013-08-13 02:50:24 [INFO    ] DP 1: 28 lwa28
2013-08-13 02:50:24 [INFO    ] DP 2: 1 lwa16
2013-08-13 02:50:24 [INFO    ] DP 2: 15 lwa34
2013-08-13 02:50:24 [INFO    ] Total of 28 boards
2013-08-13 02:50:24 [INFO    ] Total of 260 stands
2013-08-13 02:50:24 [INFO    ] -------------------
2013-08-13 02:50:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18390
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18391
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18392
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18393
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18394
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18395
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18396
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18397
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18398
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18399
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18400
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18401
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18402
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18403
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18404
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18405
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18406
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18407
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18408
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18409
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18410
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18411
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18412
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18413
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18414
2013-08-13 02:50:31 [DEBUG   ] 2013-08-13 02:50:31 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18415
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18390 exited with status 0
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18391 exited with status 0
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18392 exited with status 0
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18393 exited with status 0
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18394 exited with status 0
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18395 exited with status 0
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18396 exited with status 0
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18397 exited with status 0
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18398 exited with status 0
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18399 exited with status 0
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18400 exited with status 0
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18401 exited with status 0
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18402 exited with status 0
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18403 exited with status 0
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18404 exited with status 0
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18405 exited with status 0
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18406 exited with status 0
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18407 exited with status 0
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18408 exited with status 0
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18409 exited with status 0
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18410 exited with status 0
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18411 exited with status 0
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18412 exited with status 0
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18413 exited with status 0
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18414 exited with status 0
2013-08-13 02:50:43 [DEBUG   ] 2013-08-13 02:50:43 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18415 exited with status 0
2013-08-13 02:50:43 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2013-08-13 02:50:43 [DEBUG   ] spawn_process: at 2013-08-13 02:50:43 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:43 [DEBUG   ] spawn_process: at 2013-08-13 02:50:43 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:43 [DEBUG   ] spawn_process: at 2013-08-13 02:50:43 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:43 [DEBUG   ] spawn_process: at 2013-08-13 02:50:43 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:43 [DEBUG   ] spawn_process: at 2013-08-13 02:50:43 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:43 [DEBUG   ] spawn_process: at 2013-08-13 02:50:43 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:43 [DEBUG   ] spawn_process: at 2013-08-13 02:50:43 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:43 [DEBUG   ] spawn_process: at 2013-08-13 02:50:43 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:43 [DEBUG   ] spawn_process: at 2013-08-13 02:50:43 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:43 [DEBUG   ] spawn_process: at 2013-08-13 02:50:43 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:43 [DEBUG   ] spawn_process: at 2013-08-13 02:50:43 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:43 [DEBUG   ] spawn_process: at 2013-08-13 02:50:43 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:43 [DEBUG   ] spawn_process: at 2013-08-13 02:50:43 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:43 [DEBUG   ] spawn_process: at 2013-08-13 02:50:43 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:43 [DEBUG   ] spawn_process: at 2013-08-13 02:50:43 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:43 [DEBUG   ] spawn_process: at 2013-08-13 02:50:43 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:43 [DEBUG   ] spawn_process: at 2013-08-13 02:50:43 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:43 [DEBUG   ] spawn_process: at 2013-08-13 02:50:43 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:43 [DEBUG   ] spawn_process: at 2013-08-13 02:50:43 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:43 [DEBUG   ] spawn_process: at 2013-08-13 02:50:43 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:43 [DEBUG   ] spawn_process: at 2013-08-13 02:50:43 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:43 [DEBUG   ] spawn_process: at 2013-08-13 02:50:43 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:43 [DEBUG   ] spawn_process: at 2013-08-13 02:50:43 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:43 [DEBUG   ] spawn_process: at 2013-08-13 02:50:43 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:44 [DEBUG   ] spawn_process: at 2013-08-13 02:50:44 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:44 [DEBUG   ] spawn_process: at 2013-08-13 02:50:44 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2013-08-13 02:50:44 [DEBUG   ] 2013-08-13 02:50:44 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 18442
2013-08-13 02:50:44 [DEBUG   ] 2013-08-13 02:50:44 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 18443
2013-08-13 02:50:49 [DEBUG   ] 2013-08-13 02:50:49 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 18442 exited with status 0
2013-08-13 02:50:49 [DEBUG   ] 2013-08-13 02:50:49 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 18443 exited with status 0
2013-08-13 02:50:49 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2013-08-13 02:50:49 [DEBUG   ] spawn_process: at 2013-08-13 02:50:49 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2013-08-13 02:50:49 [DEBUG   ] spawn_process: at 2013-08-13 02:50:49 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2013-08-13 02:50:49 [INFO    ] Setting Beam 1 xbars
2013-08-13 02:50:49 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2013-08-13 02:50:49 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2013-08-13 02:50:49 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2013-08-13 02:50:49 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2013-08-13 02:50:50 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2013-08-13 02:50:50 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2013-08-13 02:50:50 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2013-08-13 02:50:50 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2013-08-13 02:50:50 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2013-08-13 02:50:50 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2013-08-13 02:50:50 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2013-08-13 02:50:50 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2013-08-13 02:50:50 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2013-08-13 02:50:51 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2013-08-13 02:50:51 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2013-08-13 02:50:51 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2013-08-13 02:50:51 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2013-08-13 02:50:51 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2013-08-13 02:50:51 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2013-08-13 02:50:51 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2013-08-13 02:50:51 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2013-08-13 02:50:51 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2013-08-13 02:50:51 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2013-08-13 02:50:52 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2013-08-13 02:50:52 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2013-08-13 02:50:52 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2013-08-13 02:50:52 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2013-08-13 02:50:52 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2013-08-13 02:50:52 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2013-08-13 02:50:52 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2013-08-13 02:50:52 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2013-08-13 02:50:52 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2013-08-13 02:50:53 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2013-08-13 02:50:53 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2013-08-13 02:50:53 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2013-08-13 02:50:53 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2013-08-13 02:50:53 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2013-08-13 02:50:53 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2013-08-13 02:50:53 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2013-08-13 02:50:53 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2013-08-13 02:50:53 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2013-08-13 02:50:54 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2013-08-13 02:50:54 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2013-08-13 02:50:54 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2013-08-13 02:50:54 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2013-08-13 02:50:54 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2013-08-13 02:50:54 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2013-08-13 02:50:54 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2013-08-13 02:50:54 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2013-08-13 02:50:54 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2013-08-13 02:50:55 [INFO    ] Setting Beam 2 xbars
2013-08-13 02:50:55 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2013-08-13 02:50:55 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2013-08-13 02:50:55 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2013-08-13 02:50:55 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2013-08-13 02:50:55 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2013-08-13 02:50:55 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2013-08-13 02:50:55 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2013-08-13 02:50:55 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2013-08-13 02:50:55 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2013-08-13 02:50:55 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2013-08-13 02:50:56 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2013-08-13 02:50:56 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2013-08-13 02:50:56 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2013-08-13 02:50:56 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2013-08-13 02:50:56 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2013-08-13 02:50:56 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2013-08-13 02:50:56 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2013-08-13 02:50:56 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2013-08-13 02:50:56 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2013-08-13 02:50:57 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2013-08-13 02:50:57 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2013-08-13 02:50:57 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2013-08-13 02:50:57 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2013-08-13 02:50:57 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2013-08-13 02:50:57 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2013-08-13 02:50:57 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2013-08-13 02:50:57 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2013-08-13 02:50:57 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2013-08-13 02:50:58 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2013-08-13 02:50:58 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2013-08-13 02:50:58 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2013-08-13 02:50:58 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2013-08-13 02:50:58 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2013-08-13 02:50:58 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2013-08-13 02:50:58 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2013-08-13 02:50:58 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2013-08-13 02:50:58 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2013-08-13 02:50:59 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2013-08-13 02:50:59 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2013-08-13 02:50:59 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2013-08-13 02:50:59 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2013-08-13 02:50:59 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2013-08-13 02:50:59 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2013-08-13 02:50:59 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2013-08-13 02:50:59 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2013-08-13 02:50:59 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2013-08-13 02:51:00 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2013-08-13 02:51:00 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2013-08-13 02:51:00 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2013-08-13 02:51:00 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2013-08-13 02:51:00 [INFO    ] Setting Beam 3 xbars
2013-08-13 02:51:00 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2013-08-13 02:51:00 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2013-08-13 02:51:00 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2013-08-13 02:51:00 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2013-08-13 02:51:00 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2013-08-13 02:51:01 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2013-08-13 02:51:01 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2013-08-13 02:51:01 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2013-08-13 02:51:01 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2013-08-13 02:51:01 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2013-08-13 02:51:01 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2013-08-13 02:51:01 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2013-08-13 02:51:01 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2013-08-13 02:51:01 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2013-08-13 02:51:02 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2013-08-13 02:51:02 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2013-08-13 02:51:02 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2013-08-13 02:51:02 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2013-08-13 02:51:02 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2013-08-13 02:51:02 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2013-08-13 02:51:02 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2013-08-13 02:51:02 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2013-08-13 02:51:02 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2013-08-13 02:51:03 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2013-08-13 02:51:03 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2013-08-13 02:51:03 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2013-08-13 02:51:03 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2013-08-13 02:51:03 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2013-08-13 02:51:03 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2013-08-13 02:51:03 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2013-08-13 02:51:03 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2013-08-13 02:51:03 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2013-08-13 02:51:03 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2013-08-13 02:51:04 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2013-08-13 02:51:04 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2013-08-13 02:51:04 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2013-08-13 02:51:04 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2013-08-13 02:51:04 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2013-08-13 02:51:04 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2013-08-13 02:51:04 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2013-08-13 02:51:04 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2013-08-13 02:51:04 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2013-08-13 02:51:05 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2013-08-13 02:51:05 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2013-08-13 02:51:05 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2013-08-13 02:51:05 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2013-08-13 02:51:05 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2013-08-13 02:51:05 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2013-08-13 02:51:05 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2013-08-13 02:51:05 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2013-08-13 02:51:05 [INFO    ] Setting Beam 4 xbars
2013-08-13 02:51:05 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2013-08-13 02:51:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2013-08-13 02:51:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2013-08-13 02:51:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2013-08-13 02:51:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2013-08-13 02:51:06 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2013-08-13 02:51:06 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2013-08-13 02:51:06 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2013-08-13 02:51:06 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2013-08-13 02:51:06 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2013-08-13 02:51:07 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2013-08-13 02:51:07 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2013-08-13 02:51:07 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2013-08-13 02:51:07 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2013-08-13 02:51:07 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2013-08-13 02:51:07 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2013-08-13 02:51:07 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2013-08-13 02:51:07 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2013-08-13 02:51:07 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2013-08-13 02:51:07 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2013-08-13 02:51:08 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2013-08-13 02:51:08 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2013-08-13 02:51:08 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2013-08-13 02:51:08 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2013-08-13 02:51:08 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2013-08-13 02:51:08 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2013-08-13 02:51:08 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2013-08-13 02:51:08 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2013-08-13 02:51:08 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2013-08-13 02:51:09 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2013-08-13 02:51:09 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2013-08-13 02:51:09 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2013-08-13 02:51:09 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2013-08-13 02:51:09 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2013-08-13 02:51:09 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2013-08-13 02:51:09 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2013-08-13 02:51:09 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2013-08-13 02:51:09 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2013-08-13 02:51:10 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2013-08-13 02:51:10 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2013-08-13 02:51:10 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2013-08-13 02:51:10 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2013-08-13 02:51:10 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2013-08-13 02:51:10 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2013-08-13 02:51:10 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2013-08-13 02:51:10 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2013-08-13 02:51:10 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2013-08-13 02:51:11 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2013-08-13 02:51:11 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2013-08-13 02:51:11 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2013-08-13 02:51:11 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2013-08-13 02:51:11 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2013-08-13 02:51:11 [INFO    ] All xbars set
2013-08-13 02:51:11 [INFO    ] Setting adder chain routing for all beams
2013-08-13 02:51:16 [INFO    ] Setting beam ids
2013-08-13 02:51:26 [INFO    ] Starting beam delay calibration
2013-08-13 02:51:38 [INFO    ] Beam 1 latency is 5718
2013-08-13 02:51:38 [INFO    ] Beam 2 latency is 5761
2013-08-13 02:51:38 [INFO    ] Beam 3 latency is 5732
2013-08-13 02:51:38 [INFO    ] Beam 4 latency is 5717
2013-08-13 02:51:38 [INFO    ] Stop calibration
2013-08-13 02:51:46 [INFO    ] Beam delay calibration successful
2013-08-13 02:51:46 [INFO    ] Calibration passed
2013-08-13 02:51:46 [DEBUG   ] spawn_process: at 2013-08-13 02:51:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2013-08-13 02:51:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2013-08-13 02:51:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2013-08-13 02:51:46 [DEBUG   ] spawn_process: at 2013-08-13 02:51:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2013-08-13 02:51:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2013-08-13 02:51:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2013-08-13 02:51:46 [DEBUG   ] spawn_process: at 2013-08-13 02:51:46 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2013-08-13 02:51:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2013-08-13 02:51:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2013-08-13 02:51:46 [DEBUG   ] spawn_process: at 2013-08-13 02:51:46 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2013-08-13 02:51:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2013-08-13 02:51:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2013-08-13 02:51:46 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -5 msec
2013-08-13 02:51:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 274 ms (1376362307.280 s) with PID 20024 and time 1376362308
2013-08-13 02:51:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -5 msec
2013-08-13 02:51:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 365 ms (1376362307.370 s) with PID 20027 and time 1376362308
2013-08-13 02:51:48 [DEBUG   ] Finished updating ant stats in 0.880 seconds
2013-08-13 02:51:48 [INFO    ] Started antennas statistics background thread
2013-08-13 02:51:48 [INFO    ] Started board flags background thread
2013-08-13 02:51:48 [INFO    ] Started BAM background thread
2013-08-13 02:51:48 [INFO    ] Finished the INI process (ref. #17961) in 107.992 s
2013-08-13 02:51:49 [DEBUG   ] Finished updating board flags in 1.059 seconds
2013-08-13 02:52:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 02:52:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 02:52:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 02:52:49 [DEBUG   ] Finished updating board flags in 0.997 seconds
2013-08-13 02:53:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 02:53:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 02:53:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 02:53:49 [DEBUG   ] Finished updating board flags in 1.301 seconds
2013-08-13 02:54:00 [DEBUG   ] Got command RPT from MCS: ref #17962
2013-08-13 02:54:00 [DEBUG   ] summary = NORMAL
2013-08-13 02:54:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17962  14 56517 10440019 A NORMALNORMAL'
2013-08-13 02:54:00 [DEBUG   ] Got command RPT from MCS: ref #17963
2013-08-13 02:54:00 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 02:54:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17963  48 56517 10440019 A NORMALSystem calibrated and operating normally'
2013-08-13 02:54:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 02:54:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 02:54:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 02:54:49 [DEBUG   ] Finished updating board flags in 1.136 seconds
2013-08-13 02:55:00 [DEBUG   ] Got command RPT from MCS: ref #17980
2013-08-13 02:55:00 [DEBUG   ] summary = NORMAL
2013-08-13 02:55:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    17980  14 56517 10500491 A NORMALNORMAL'
2013-08-13 02:55:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 02:55:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 02:55:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 02:55:49 [DEBUG   ] Finished updating board flags in 1.062 seconds
2013-08-13 02:56:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 02:56:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 02:56:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 02:56:49 [DEBUG   ] Finished updating board flags in 0.949 seconds
2013-08-13 02:57:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 02:57:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 02:57:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 02:57:50 [DEBUG   ] Finished updating board flags in 1.406 seconds
2013-08-13 02:58:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 02:58:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 02:58:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 02:58:50 [DEBUG   ] Finished updating board flags in 1.382 seconds
2013-08-13 02:59:00 [DEBUG   ] Got command RPT from MCS: ref #18019
2013-08-13 02:59:00 [DEBUG   ] summary = NORMAL
2013-08-13 02:59:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18019  14 56517 10740019 A NORMALNORMAL'
2013-08-13 02:59:00 [DEBUG   ] Got command RPT from MCS: ref #18020
2013-08-13 02:59:00 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 02:59:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18020  48 56517 10740019 A NORMALSystem calibrated and operating normally'
2013-08-13 02:59:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 02:59:28 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-13 02:59:48 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-13 02:59:50 [DEBUG   ] Finished updating board flags in 1.187 seconds
2013-08-13 02:59:58 [DEBUG   ] Got command TBW from MCS: ref #18037
2013-08-13 02:59:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 02:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18037   8 56517 10798015 A NORMAL'
2013-08-13 02:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 02:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 02:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 02:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 02:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 02:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 02:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 02:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 02:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 02:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 02:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 02:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 02:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 02:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 02:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 02:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 02:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 02:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 02:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 02:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 02:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 02:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 02:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 03:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 03:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 03:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 03:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 03:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 03:00:00 [DEBUG   ] spawn_process: at 2013-08-13 03:00:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 03:00:00 [INFO    ] Finished spawning TBW
2013-08-13 03:00:50 [DEBUG   ] Finished updating board flags in 1.189 seconds
2013-08-13 03:01:51 [DEBUG   ] Finished updating board flags in 1.961 seconds
2013-08-13 03:02:50 [DEBUG   ] Finished updating board flags in 1.122 seconds
2013-08-13 03:03:38 [INFO    ] __waitForTBW - TBW finished in 218.736 s
2013-08-13 03:03:39 [INFO    ] Started antennas statistics background thread
2013-08-13 03:03:40 [DEBUG   ] Finished updating ant stats in 1.299 seconds
2013-08-13 03:03:50 [DEBUG   ] Finished updating board flags in 0.993 seconds
2013-08-13 03:04:00 [DEBUG   ] Got command RPT from MCS: ref #18043
2013-08-13 03:04:00 [DEBUG   ] summary = NORMAL
2013-08-13 03:04:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18043  14 56517 11040015 A NORMALNORMAL'
2013-08-13 03:04:00 [DEBUG   ] Got command RPT from MCS: ref #18044
2013-08-13 03:04:00 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 03:04:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18044  48 56517 11040015 A NORMALSystem calibrated and operating normally'
2013-08-13 03:04:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-13 03:04:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-13 03:04:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-13 03:04:51 [DEBUG   ] Finished updating board flags in 1.338 seconds
2013-08-13 03:05:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-13 03:05:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-13 03:05:23 [DEBUG   ] Got command TBN from MCS: ref #18067
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376363124']
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376363124']
2013-08-13 03:05:23 [DEBUG   ] tbn = exited with status True, code 0x00
2013-08-13 03:05:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN    18067   8 56517 11123023 A NORMAL'
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376363124']
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376363124']
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376363124']
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376363124']
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376363124']
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376363124']
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376363124']
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376363124']
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376363124']
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376363124']
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376363124']
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376363124']
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376363124']
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376363124']
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376363124']
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376363124']
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376363124']
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376363124']
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376363124']
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376363124']
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376363124']
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376363124']
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376363124']
2013-08-13 03:05:23 [DEBUG   ] spawn_process: at 2013-08-13 03:05:23 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376363124']
2013-08-13 03:05:23 [INFO    ] Finished spawning TBN in 0.047 s
2013-08-13 03:05:40 [DEBUG   ] Finished updating ant stats in 1.267 seconds
2013-08-13 03:05:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-08-13 03:05:51 [DEBUG   ] Finished updating board flags in 1.426 seconds
2013-08-13 03:05:58 [DEBUG   ] Got command TBW from MCS: ref #18069
2013-08-13 03:05:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 03:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18069   8 56517 11158011 A NORMAL'
2013-08-13 03:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 03:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 03:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 03:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 03:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 03:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 03:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 03:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 03:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 03:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 03:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 03:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 03:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 03:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 03:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 03:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 03:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 03:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 03:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 03:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 03:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 03:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 03:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 03:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 03:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 03:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 03:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 03:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 03:06:01 [DEBUG   ] spawn_process: at 2013-08-13 03:06:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 03:06:01 [INFO    ] Finished spawning TBW
2013-08-13 03:06:51 [DEBUG   ] Finished updating board flags in 1.317 seconds
2013-08-13 03:07:51 [DEBUG   ] Finished updating board flags in 1.097 seconds
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-08-13 03:08:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-08-13 03:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-08-13 03:08:52 [DEBUG   ] Finished updating board flags in 2.126 seconds
2013-08-13 03:09:00 [DEBUG   ] Got command RPT from MCS: ref #18071
2013-08-13 03:09:00 [DEBUG   ] summary = NORMAL
2013-08-13 03:09:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18071  14 56517 11340019 A NORMALNORMAL'
2013-08-13 03:09:00 [DEBUG   ] Got command RPT from MCS: ref #18072
2013-08-13 03:09:00 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 03:09:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18072  48 56517 11340019 A NORMALSystem calibrated and operating normally'
2013-08-13 03:09:40 [INFO    ] __waitForTBW - TBW finished in 218.584 s
2013-08-13 03:09:41 [INFO    ] Started antennas statistics background thread
2013-08-13 03:09:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376363382']
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376363382']
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376363382']
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376363382']
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376363382']
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376363382']
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376363382']
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376363382']
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376363382']
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376363382']
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376363382']
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376363382']
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376363382']
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376363382']
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376363382']
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376363382']
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376363382']
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376363382']
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376363382']
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376363382']
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376363382']
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376363382']
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376363382']
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376363382']
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376363382']
2013-08-13 03:09:41 [DEBUG   ] spawn_process: at 2013-08-13 03:09:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376363382']
2013-08-13 03:09:41 [INFO    ] Finished spawning TBN in 0.050 s
2013-08-13 03:09:41 [DEBUG   ] Finished updating ant stats in 1.266 seconds
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-13 03:09:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-13 03:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-13 03:09:52 [DEBUG   ] Finished updating board flags in 2.217 seconds
2013-08-13 03:10:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-13 03:10:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 03:10:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 03:10:52 [DEBUG   ] Finished updating board flags in 2.030 seconds
2013-08-13 03:11:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 03:11:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 03:11:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 03:11:52 [DEBUG   ] Finished updating board flags in 2.024 seconds
2013-08-13 03:11:58 [DEBUG   ] Got command TBW from MCS: ref #18089
2013-08-13 03:11:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 03:11:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18089   8 56517 11518015 A NORMAL'
2013-08-13 03:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 03:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 03:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 03:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 03:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 03:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 03:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 03:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 03:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 03:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 03:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 03:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 03:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 03:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 03:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 03:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 03:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 03:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 03:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 03:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 03:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 03:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 03:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 03:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 03:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 03:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 03:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 03:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 03:12:01 [DEBUG   ] spawn_process: at 2013-08-13 03:12:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 03:12:01 [INFO    ] Finished spawning TBW
2013-08-13 03:12:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 03:12:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 03:12:52 [DEBUG   ] Finished updating board flags in 1.791 seconds
2013-08-13 03:13:52 [DEBUG   ] Finished updating board flags in 1.734 seconds
2013-08-13 03:14:00 [DEBUG   ] Got command RPT from MCS: ref #18091
2013-08-13 03:14:00 [DEBUG   ] summary = NORMAL
2013-08-13 03:14:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18091  14 56517 11640023 A NORMALNORMAL'
2013-08-13 03:14:00 [DEBUG   ] Got command RPT from MCS: ref #18092
2013-08-13 03:14:00 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 03:14:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18092  48 56517 11640023 A NORMALSystem calibrated and operating normally'
2013-08-13 03:14:51 [DEBUG   ] Finished updating board flags in 0.952 seconds
2013-08-13 03:15:40 [INFO    ] __waitForTBW - TBW finished in 218.462 s
2013-08-13 03:15:41 [INFO    ] Started antennas statistics background thread
2013-08-13 03:15:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376363742']
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376363742']
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376363742']
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376363742']
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376363742']
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376363742']
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376363742']
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376363742']
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376363742']
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376363742']
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376363742']
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376363742']
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376363742']
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376363742']
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376363742']
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376363742']
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376363742']
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376363742']
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376363742']
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376363742']
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376363742']
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376363742']
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376363742']
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376363742']
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376363742']
2013-08-13 03:15:41 [DEBUG   ] spawn_process: at 2013-08-13 03:15:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376363742']
2013-08-13 03:15:41 [INFO    ] Finished spawning TBN in 0.054 s
2013-08-13 03:15:41 [DEBUG   ] Finished updating ant stats in 1.222 seconds
2013-08-13 03:15:52 [DEBUG   ] Finished updating board flags in 1.527 seconds
2013-08-13 03:16:01 [DEBUG   ] Finished updating ant stats in 1.186 seconds
2013-08-13 03:16:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 03:16:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 03:16:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 03:16:52 [DEBUG   ] Finished updating board flags in 1.392 seconds
2013-08-13 03:17:01 [DEBUG   ] Finished updating ant stats in 0.872 seconds
2013-08-13 03:17:21 [DEBUG   ] Finished updating ant stats in 0.727 seconds
2013-08-13 03:17:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 03:17:52 [DEBUG   ] Finished updating board flags in 1.479 seconds
2013-08-13 03:17:58 [DEBUG   ] Got command TBW from MCS: ref #18109
2013-08-13 03:17:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 03:17:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18109   8 56517 11878011 A NORMAL'
2013-08-13 03:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 03:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 03:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 03:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 03:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 03:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 03:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 03:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 03:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 03:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 03:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 03:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 03:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 03:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 03:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 03:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 03:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 03:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 03:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 03:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 03:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 03:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 03:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 03:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 03:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 03:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 03:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 03:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 03:18:01 [DEBUG   ] spawn_process: at 2013-08-13 03:18:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 03:18:01 [INFO    ] Finished spawning TBW
2013-08-13 03:18:53 [DEBUG   ] Finished updating board flags in 2.058 seconds
2013-08-13 03:19:00 [DEBUG   ] Got command RPT from MCS: ref #18111
2013-08-13 03:19:00 [DEBUG   ] summary = NORMAL
2013-08-13 03:19:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18111  14 56517 11940015 A NORMALNORMAL'
2013-08-13 03:19:00 [DEBUG   ] Got command RPT from MCS: ref #18112
2013-08-13 03:19:00 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 03:19:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18112  48 56517 11940016 A NORMALSystem calibrated and operating normally'
2013-08-13 03:19:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 03:19:53 [DEBUG   ] Finished updating board flags in 1.874 seconds
2013-08-13 03:20:53 [DEBUG   ] Finished updating board flags in 1.402 seconds
2013-08-13 03:21:39 [INFO    ] __waitForTBW - TBW finished in 218.487 s
2013-08-13 03:21:40 [INFO    ] Started antennas statistics background thread
2013-08-13 03:21:40 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 03:21:40 [DEBUG   ] spawn_process: at 2013-08-13 03:21:40 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376364102']
2013-08-13 03:21:40 [DEBUG   ] spawn_process: at 2013-08-13 03:21:40 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376364102']
2013-08-13 03:21:40 [DEBUG   ] spawn_process: at 2013-08-13 03:21:40 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376364102']
2013-08-13 03:21:40 [DEBUG   ] spawn_process: at 2013-08-13 03:21:40 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376364102']
2013-08-13 03:21:40 [DEBUG   ] spawn_process: at 2013-08-13 03:21:40 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376364102']
2013-08-13 03:21:40 [DEBUG   ] spawn_process: at 2013-08-13 03:21:40 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376364102']
2013-08-13 03:21:40 [DEBUG   ] spawn_process: at 2013-08-13 03:21:40 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376364102']
2013-08-13 03:21:40 [DEBUG   ] spawn_process: at 2013-08-13 03:21:40 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376364102']
2013-08-13 03:21:40 [DEBUG   ] spawn_process: at 2013-08-13 03:21:40 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376364102']
2013-08-13 03:21:40 [DEBUG   ] spawn_process: at 2013-08-13 03:21:40 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376364102']
2013-08-13 03:21:40 [DEBUG   ] spawn_process: at 2013-08-13 03:21:40 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376364102']
2013-08-13 03:21:40 [DEBUG   ] spawn_process: at 2013-08-13 03:21:40 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376364102']
2013-08-13 03:21:40 [DEBUG   ] spawn_process: at 2013-08-13 03:21:40 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376364102']
2013-08-13 03:21:40 [DEBUG   ] spawn_process: at 2013-08-13 03:21:40 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376364102']
2013-08-13 03:21:40 [DEBUG   ] spawn_process: at 2013-08-13 03:21:40 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376364102']
2013-08-13 03:21:41 [DEBUG   ] spawn_process: at 2013-08-13 03:21:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376364102']
2013-08-13 03:21:41 [DEBUG   ] spawn_process: at 2013-08-13 03:21:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376364102']
2013-08-13 03:21:41 [DEBUG   ] spawn_process: at 2013-08-13 03:21:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376364102']
2013-08-13 03:21:41 [DEBUG   ] spawn_process: at 2013-08-13 03:21:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376364102']
2013-08-13 03:21:41 [DEBUG   ] spawn_process: at 2013-08-13 03:21:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376364102']
2013-08-13 03:21:41 [DEBUG   ] spawn_process: at 2013-08-13 03:21:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376364102']
2013-08-13 03:21:41 [DEBUG   ] spawn_process: at 2013-08-13 03:21:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376364102']
2013-08-13 03:21:41 [DEBUG   ] spawn_process: at 2013-08-13 03:21:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376364102']
2013-08-13 03:21:41 [DEBUG   ] spawn_process: at 2013-08-13 03:21:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376364102']
2013-08-13 03:21:41 [DEBUG   ] spawn_process: at 2013-08-13 03:21:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376364102']
2013-08-13 03:21:41 [DEBUG   ] spawn_process: at 2013-08-13 03:21:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376364102']
2013-08-13 03:21:41 [INFO    ] Finished spawning TBN in 0.050 s
2013-08-13 03:21:41 [DEBUG   ] Finished updating ant stats in 1.283 seconds
2013-08-13 03:21:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-08-13 03:21:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 03:21:53 [DEBUG   ] Finished updating board flags in 2.164 seconds
2013-08-13 03:22:01 [DEBUG   ] Finished updating ant stats in 1.271 seconds
2013-08-13 03:22:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 03:22:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 03:22:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 03:22:53 [DEBUG   ] Finished updating board flags in 1.839 seconds
2013-08-13 03:23:01 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2013-08-13 03:23:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 03:23:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 03:23:53 [DEBUG   ] Finished updating board flags in 1.817 seconds
2013-08-13 03:23:58 [DEBUG   ] Got command TBW from MCS: ref #18129
2013-08-13 03:23:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 03:23:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18129   8 56517 12238007 A NORMAL'
2013-08-13 03:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 03:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 03:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 03:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 03:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 03:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 03:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 03:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 03:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 03:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 03:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 03:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 03:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 03:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 03:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 03:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 03:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 03:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 03:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 03:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 03:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 03:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 03:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 03:24:01 [DEBUG   ] Got command RPT from MCS: ref #18131
2013-08-13 03:24:01 [DEBUG   ] summary = NORMAL
2013-08-13 03:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18131  14 56517 12241159 A NORMALNORMAL'
2013-08-13 03:24:01 [DEBUG   ] Got command RPT from MCS: ref #18132
2013-08-13 03:24:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 03:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18132  48 56517 12241160 A NORMALSystem calibrated and operating normally'
2013-08-13 03:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 03:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 03:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 03:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 03:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 03:24:01 [DEBUG   ] spawn_process: at 2013-08-13 03:24:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 03:24:01 [INFO    ] Finished spawning TBW
2013-08-13 03:24:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 03:24:53 [DEBUG   ] Finished updating board flags in 1.595 seconds
2013-08-13 03:25:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 03:25:53 [DEBUG   ] Finished updating board flags in 1.536 seconds
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-08-13 03:26:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-08-13 03:26:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 03:26:53 [DEBUG   ] Finished updating board flags in 1.269 seconds
2013-08-13 03:27:39 [INFO    ] __waitForTBW - TBW finished in 218.198 s
2013-08-13 03:27:40 [DEBUG   ] Finished updating ant stats in 0.467 seconds
2013-08-13 03:27:40 [INFO    ] Started antennas statistics background thread
2013-08-13 03:27:40 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376364462']
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376364462']
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376364462']
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376364462']
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376364462']
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376364462']
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376364462']
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376364462']
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376364462']
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376364462']
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376364462']
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376364462']
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376364462']
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376364462']
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376364462']
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376364462']
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376364462']
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376364462']
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376364462']
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376364462']
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376364462']
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376364462']
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376364462']
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376364462']
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376364462']
2013-08-13 03:27:40 [DEBUG   ] spawn_process: at 2013-08-13 03:27:40 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376364462']
2013-08-13 03:27:40 [INFO    ] Finished spawning TBN in 0.046 s
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-13 03:27:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-13 03:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-13 03:27:54 [DEBUG   ] Finished updating board flags in 2.415 seconds
2013-08-13 03:28:00 [DEBUG   ] Finished updating ant stats in 0.459 seconds
2013-08-13 03:28:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-13 03:28:41 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-08-13 03:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-08-13 03:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-08-13 03:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-08-13 03:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-08-13 03:28:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-08-13 03:28:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-08-13 03:28:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-08-13 03:28:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-08-13 03:28:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-08-13 03:28:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-08-13 03:28:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-08-13 03:28:53 [DEBUG   ] Finished updating board flags in 1.389 seconds
2013-08-13 03:29:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-13 03:29:01 [DEBUG   ] Got command RPT from MCS: ref #18148
2013-08-13 03:29:01 [DEBUG   ] summary = NORMAL
2013-08-13 03:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18148  14 56517 12541167 A NORMALNORMAL'
2013-08-13 03:29:01 [DEBUG   ] Got command RPT from MCS: ref #18149
2013-08-13 03:29:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 03:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18149  48 56517 12541167 A NORMALSystem calibrated and operating normally'
2013-08-13 03:29:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-13 03:29:40 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-08-13 03:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-08-13 03:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-08-13 03:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-08-13 03:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-08-13 03:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-08-13 03:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-08-13 03:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-08-13 03:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-08-13 03:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-08-13 03:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-08-13 03:29:54 [DEBUG   ] Finished updating board flags in 2.297 seconds
2013-08-13 03:29:58 [DEBUG   ] Got command TBW from MCS: ref #18166
2013-08-13 03:29:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 03:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18166   8 56517 12598019 A NORMAL'
2013-08-13 03:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 03:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 03:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 03:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 03:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 03:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 03:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 03:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 03:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 03:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 03:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 03:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 03:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 03:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 03:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 03:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 03:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 03:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 03:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 03:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 03:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 03:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 03:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 03:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 03:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 03:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 03:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 03:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 03:30:01 [DEBUG   ] spawn_process: at 2013-08-13 03:30:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 03:30:01 [INFO    ] Finished spawning TBW
2013-08-13 03:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-08-13 03:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-08-13 03:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-08-13 03:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-08-13 03:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-08-13 03:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-08-13 03:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-08-13 03:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-08-13 03:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-08-13 03:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-08-13 03:30:53 [DEBUG   ] Finished updating board flags in 1.393 seconds
2013-08-13 03:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-08-13 03:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-08-13 03:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-08-13 03:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-08-13 03:31:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-08-13 03:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-08-13 03:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-08-13 03:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-08-13 03:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-08-13 03:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-08-13 03:31:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 03:31:54 [DEBUG   ] Finished updating board flags in 1.843 seconds
2013-08-13 03:32:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-08-13 03:32:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-08-13 03:32:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-08-13 03:32:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-08-13 03:32:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-08-13 03:32:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-08-13 03:32:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-08-13 03:32:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-08-13 03:32:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-08-13 03:32:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-08-13 03:32:54 [DEBUG   ] Finished updating board flags in 1.663 seconds
2013-08-13 03:33:40 [INFO    ] __waitForTBW - TBW finished in 218.542 s
2013-08-13 03:33:41 [INFO    ] Started antennas statistics background thread
2013-08-13 03:33:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376364822']
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376364822']
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376364822']
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376364822']
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376364822']
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376364822']
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376364822']
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376364822']
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376364822']
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376364822']
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376364822']
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376364822']
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376364822']
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376364822']
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376364822']
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376364822']
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376364822']
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376364822']
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376364822']
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376364822']
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376364822']
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376364822']
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376364822']
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376364822']
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376364822']
2013-08-13 03:33:41 [DEBUG   ] spawn_process: at 2013-08-13 03:33:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376364822']
2013-08-13 03:33:41 [INFO    ] Finished spawning TBN in 0.051 s
2013-08-13 03:33:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 03:33:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-08-13 03:33:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-08-13 03:33:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-08-13 03:33:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-08-13 03:33:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-08-13 03:33:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-08-13 03:33:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-08-13 03:33:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-08-13 03:33:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-08-13 03:33:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-08-13 03:33:54 [DEBUG   ] Finished updating board flags in 1.805 seconds
2013-08-13 03:34:01 [DEBUG   ] Got command RPT from MCS: ref #18168
2013-08-13 03:34:01 [DEBUG   ] summary = NORMAL
2013-08-13 03:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18168  14 56517 12841167 A NORMALNORMAL'
2013-08-13 03:34:01 [DEBUG   ] Got command RPT from MCS: ref #18169
2013-08-13 03:34:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 03:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18169  48 56517 12841167 A NORMALSystem calibrated and operating normally'
2013-08-13 03:34:01 [DEBUG   ] Finished updating ant stats in 1.180 seconds
2013-08-13 03:34:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 03:34:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 03:34:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-08-13 03:34:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-08-13 03:34:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-08-13 03:34:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-08-13 03:34:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-08-13 03:34:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-08-13 03:34:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-08-13 03:34:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-08-13 03:34:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-08-13 03:34:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-08-13 03:34:54 [DEBUG   ] Finished updating board flags in 1.816 seconds
2013-08-13 03:35:01 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 03:35:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 03:35:41 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2013-08-13 03:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-08-13 03:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-08-13 03:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-08-13 03:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-08-13 03:35:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-08-13 03:35:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-08-13 03:35:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-08-13 03:35:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-08-13 03:35:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-08-13 03:35:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-08-13 03:35:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 03:35:54 [DEBUG   ] Finished updating board flags in 1.780 seconds
2013-08-13 03:35:58 [DEBUG   ] Got command TBW from MCS: ref #18186
2013-08-13 03:35:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 03:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18186   8 56517 12958007 A NORMAL'
2013-08-13 03:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 03:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 03:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 03:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 03:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 03:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 03:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 03:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 03:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 03:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 03:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 03:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 03:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 03:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 03:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 03:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 03:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 03:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 03:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 03:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 03:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 03:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 03:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 03:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 03:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 03:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 03:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 03:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 03:36:01 [DEBUG   ] spawn_process: at 2013-08-13 03:36:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 03:36:01 [INFO    ] Finished spawning TBW
2013-08-13 03:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-08-13 03:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-08-13 03:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-08-13 03:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-08-13 03:36:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-08-13 03:36:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-08-13 03:36:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-08-13 03:36:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-08-13 03:36:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-08-13 03:36:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-08-13 03:36:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 03:36:54 [DEBUG   ] Finished updating board flags in 1.543 seconds
2013-08-13 03:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-08-13 03:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-08-13 03:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-08-13 03:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-08-13 03:37:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-08-13 03:37:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-08-13 03:37:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-08-13 03:37:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-08-13 03:37:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-08-13 03:37:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-08-13 03:37:54 [DEBUG   ] Finished updating board flags in 1.274 seconds
2013-08-13 03:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-08-13 03:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-08-13 03:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-08-13 03:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-08-13 03:38:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-08-13 03:38:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-08-13 03:38:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-08-13 03:38:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-08-13 03:38:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-08-13 03:38:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-08-13 03:38:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-08-13 03:38:54 [DEBUG   ] Finished updating board flags in 1.324 seconds
2013-08-13 03:39:01 [DEBUG   ] Got command RPT from MCS: ref #18188
2013-08-13 03:39:01 [DEBUG   ] summary = NORMAL
2013-08-13 03:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18188  14 56517 13141167 A NORMALNORMAL'
2013-08-13 03:39:01 [DEBUG   ] Got command RPT from MCS: ref #18189
2013-08-13 03:39:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 03:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18189  48 56517 13141167 A NORMALSystem calibrated and operating normally'
2013-08-13 03:39:39 [INFO    ] __waitForTBW - TBW finished in 218.370 s
2013-08-13 03:39:40 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-08-13 03:39:40 [INFO    ] Started antennas statistics background thread
2013-08-13 03:39:40 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376365182']
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376365182']
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376365182']
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376365182']
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376365182']
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376365182']
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376365182']
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376365182']
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376365182']
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376365182']
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376365182']
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376365182']
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376365182']
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376365182']
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376365182']
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376365182']
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376365182']
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376365182']
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376365182']
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376365182']
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376365182']
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376365182']
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376365182']
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376365182']
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376365182']
2013-08-13 03:39:40 [DEBUG   ] spawn_process: at 2013-08-13 03:39:40 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376365182']
2013-08-13 03:39:40 [INFO    ] Finished spawning TBN in 0.049 s
2013-08-13 03:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-08-13 03:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-08-13 03:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-08-13 03:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-08-13 03:39:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-08-13 03:39:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-08-13 03:39:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-08-13 03:39:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-08-13 03:39:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-08-13 03:39:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-08-13 03:39:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 03:39:55 [DEBUG   ] Finished updating board flags in 1.640 seconds
2013-08-13 03:40:01 [DEBUG   ] Finished updating ant stats in 1.270 seconds
2013-08-13 03:40:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 03:40:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 03:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-08-13 03:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-08-13 03:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-08-13 03:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-08-13 03:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-08-13 03:40:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-08-13 03:40:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-08-13 03:40:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-08-13 03:40:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-08-13 03:40:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-08-13 03:40:55 [DEBUG   ] Finished updating board flags in 1.638 seconds
2013-08-13 03:41:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-13 03:41:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 03:41:41 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2013-08-13 03:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-08-13 03:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-08-13 03:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-08-13 03:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-08-13 03:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-08-13 03:41:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-08-13 03:41:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-08-13 03:41:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-08-13 03:41:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-08-13 03:41:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-08-13 03:41:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-08-13 03:41:55 [DEBUG   ] Finished updating board flags in 1.634 seconds
2013-08-13 03:41:58 [DEBUG   ] Got command TBW from MCS: ref #18206
2013-08-13 03:41:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 03:41:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18206   8 56517 13318015 A NORMAL'
2013-08-13 03:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 03:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 03:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 03:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 03:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 03:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 03:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 03:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 03:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 03:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 03:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 03:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 03:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 03:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 03:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 03:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 03:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 03:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 03:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 03:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 03:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 03:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 03:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 03:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 03:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 03:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 03:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 03:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 03:42:01 [DEBUG   ] spawn_process: at 2013-08-13 03:42:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 03:42:01 [INFO    ] Finished spawning TBW
2013-08-13 03:42:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-08-13 03:42:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-08-13 03:42:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-08-13 03:42:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-08-13 03:42:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-08-13 03:42:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-08-13 03:42:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-08-13 03:42:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-08-13 03:42:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-08-13 03:42:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-08-13 03:42:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 03:42:55 [DEBUG   ] Finished updating board flags in 2.102 seconds
2013-08-13 03:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-08-13 03:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-08-13 03:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-08-13 03:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-08-13 03:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-08-13 03:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-08-13 03:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-08-13 03:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-08-13 03:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-08-13 03:43:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-08-13 03:43:54 [DEBUG   ] Finished updating board flags in 1.330 seconds
2013-08-13 03:44:01 [DEBUG   ] Got command RPT from MCS: ref #18208
2013-08-13 03:44:01 [DEBUG   ] summary = NORMAL
2013-08-13 03:44:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18208  14 56517 13441167 A NORMALNORMAL'
2013-08-13 03:44:01 [DEBUG   ] Got command RPT from MCS: ref #18209
2013-08-13 03:44:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 03:44:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18209  48 56517 13441167 A NORMALSystem calibrated and operating normally'
2013-08-13 03:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-08-13 03:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-08-13 03:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-08-13 03:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-08-13 03:44:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-08-13 03:44:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-08-13 03:44:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-08-13 03:44:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-08-13 03:44:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-08-13 03:44:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-08-13 03:44:55 [DEBUG   ] Finished updating board flags in 1.875 seconds
2013-08-13 03:45:40 [INFO    ] __waitForTBW - TBW finished in 218.542 s
2013-08-13 03:45:41 [INFO    ] Started antennas statistics background thread
2013-08-13 03:45:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376365542']
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376365542']
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376365542']
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376365542']
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376365542']
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376365542']
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376365542']
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376365542']
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376365542']
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376365542']
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376365542']
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376365542']
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376365542']
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376365542']
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376365542']
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376365542']
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376365542']
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376365542']
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376365542']
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376365542']
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376365542']
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376365542']
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376365542']
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376365542']
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376365542']
2013-08-13 03:45:41 [DEBUG   ] spawn_process: at 2013-08-13 03:45:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376365542']
2013-08-13 03:45:41 [INFO    ] Finished spawning TBN in 0.053 s
2013-08-13 03:45:41 [DEBUG   ] Finished updating ant stats in 1.272 seconds
2013-08-13 03:45:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-08-13 03:45:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-08-13 03:45:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-08-13 03:45:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-08-13 03:45:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-08-13 03:45:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-08-13 03:45:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-08-13 03:45:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-08-13 03:45:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-08-13 03:45:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-08-13 03:45:55 [DEBUG   ] Finished updating board flags in 2.011 seconds
2013-08-13 03:46:01 [DEBUG   ] Finished updating ant stats in 1.236 seconds
2013-08-13 03:46:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-13 03:46:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 03:46:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-08-13 03:46:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-08-13 03:46:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-08-13 03:46:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-08-13 03:46:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-08-13 03:46:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-08-13 03:46:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-08-13 03:46:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-08-13 03:46:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-08-13 03:46:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-08-13 03:46:55 [DEBUG   ] Finished updating board flags in 1.854 seconds
2013-08-13 03:47:01 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 03:47:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 03:47:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 03:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-08-13 03:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-08-13 03:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-08-13 03:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-08-13 03:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-08-13 03:47:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-08-13 03:47:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-08-13 03:47:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-08-13 03:47:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-08-13 03:47:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-08-13 03:47:55 [DEBUG   ] Finished updating board flags in 1.814 seconds
2013-08-13 03:47:58 [DEBUG   ] Got command TBW from MCS: ref #18226
2013-08-13 03:47:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 03:47:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18226   8 56517 13678015 A NORMAL'
2013-08-13 03:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 03:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 03:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 03:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 03:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 03:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 03:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 03:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 03:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 03:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 03:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 03:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 03:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 03:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 03:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 03:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 03:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 03:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 03:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 03:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 03:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 03:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 03:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 03:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 03:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 03:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 03:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 03:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 03:48:01 [DEBUG   ] spawn_process: at 2013-08-13 03:48:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 03:48:01 [INFO    ] Finished spawning TBW
2013-08-13 03:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-08-13 03:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-08-13 03:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-08-13 03:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-08-13 03:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-08-13 03:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-08-13 03:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-08-13 03:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-08-13 03:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-08-13 03:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-08-13 03:48:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 03:48:54 [DEBUG   ] Finished updating board flags in 1.068 seconds
2013-08-13 03:49:01 [DEBUG   ] Got command RPT from MCS: ref #18228
2013-08-13 03:49:01 [DEBUG   ] summary = NORMAL
2013-08-13 03:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18228  14 56517 13741171 A NORMALNORMAL'
2013-08-13 03:49:01 [DEBUG   ] Got command RPT from MCS: ref #18229
2013-08-13 03:49:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 03:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18229  48 56517 13741171 A NORMALSystem calibrated and operating normally'
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 57910128
2013-08-13 03:49:54 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767696604000000
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 57899114
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 57911018
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 57908714
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 57911576
2013-08-13 03:49:54 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767696604000000
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 1, top port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 1, bottom port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 5, top port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 5, bottom port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 1, top port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 1, bottom port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 5, bottom port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 1, top port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 1, bottom port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 5, top port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 5, bottom port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 1, top port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 1, bottom port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 5, top port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 5, bottom port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 1, top port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 1, bottom port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 5, top port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 5, bottom port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 1, top port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 1, bottom port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 5, top port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 5, bottom port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 1, top port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 1, bottom port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 5, top port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 5, bottom port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 1, top port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 1, bottom port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 5, top port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 5, bottom port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 1, top port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 1, bottom port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 5, top port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 5, bottom port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 1, top port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 5, top port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 5, bottom port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 1, top port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 1, bottom port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 5, top port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 5, bottom port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, top port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 5, top port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 5, bottom port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 1, top port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 2, top port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 4, bottom port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 58933204
2013-08-13 03:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 5, bottom port
2013-08-13 03:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 57889014
2013-08-13 03:49:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767696800000000
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 57880658
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 57887108
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 57890296
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 57890400
2013-08-13 03:49:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767696800000000
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 1, top port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 1, bottom port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 5, top port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 5, bottom port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 1, top port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 1, bottom port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 5, bottom port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 1, top port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 1, bottom port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 5, top port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 5, bottom port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 1, top port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 1, bottom port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 5, top port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 5, bottom port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 1, top port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 1, bottom port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 5, top port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 5, bottom port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 1, top port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 1, bottom port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 5, top port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 5, bottom port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 1, top port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 1, bottom port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 5, top port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 5, bottom port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 1, top port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 1, bottom port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 5, top port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 5, bottom port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 1, top port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 1, bottom port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 5, top port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 5, bottom port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 1, top port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, top port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 1, top port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 1, bottom port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 5, top port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 5, bottom port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 1, top port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 1, bottom port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 5, top port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 5, bottom port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 1, top port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 2, top port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 4, bottom port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 5, bottom port
2013-08-13 03:49:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 58933204
2013-08-13 03:49:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 03:49:55 [CRITICAL] MGT underflow detected on beam(s) 4, 1, 2, 3
2013-08-13 03:49:55 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 03:49:55 [DEBUG   ] Finished updating board flags in 1.681 seconds
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 120522967
2013-08-13 03:50:54 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767710324000000
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 120485947
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 120526369
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 120516996
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 120527236
2013-08-13 03:50:54 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767710324000000
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 1, top port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 1, bottom port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 5, top port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 5, bottom port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 1, top port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 1, bottom port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 5, bottom port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 1, top port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 1, bottom port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 5, top port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 5, bottom port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 1, top port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 1, bottom port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 5, top port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 5, bottom port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 1, top port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 1, bottom port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 5, top port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 5, bottom port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 1, top port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 1, bottom port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 5, top port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 5, bottom port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 1, top port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 1, bottom port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 5, top port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 5, bottom port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 1, top port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 1, bottom port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 5, top port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 5, bottom port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 1, top port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 1, bottom port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 5, top port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 5, bottom port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 1, top port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 5, top port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 5, bottom port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 1, top port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 1, bottom port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 5, top port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 5, bottom port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, top port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 5, top port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 5, bottom port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 1, top port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 2, top port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 4, bottom port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-13 03:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 5, bottom port
2013-08-13 03:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 120445537
2013-08-13 03:50:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767710520000000
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 120419858
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 120440366
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 120449809
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 120452003
2013-08-13 03:50:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767710520000000
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 1, top port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 1, bottom port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 5, top port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 5, bottom port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 1, top port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 1, bottom port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 5, bottom port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 1, top port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 1, bottom port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 5, top port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 5, bottom port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 1, top port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 1, bottom port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 5, top port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 5, bottom port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 1, top port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 1, bottom port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 5, top port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 5, bottom port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 1, top port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 1, bottom port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 5, top port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 5, bottom port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 1, top port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 1, bottom port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 5, top port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 5, bottom port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 1, top port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 1, bottom port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 5, top port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 5, bottom port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 1, top port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 1, bottom port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 5, top port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 5, bottom port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 1, top port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, top port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 1, top port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 1, bottom port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 5, top port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 5, bottom port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 1, top port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 1, bottom port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 5, top port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 5, bottom port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 1, top port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 2, top port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 4, bottom port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-13 03:50:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 5, bottom port
2013-08-13 03:50:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-13 03:50:55 [CRITICAL] MGT underflow detected on beam(s) 4, 1, 2, 3
2013-08-13 03:50:55 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 03:50:55 [DEBUG   ] Finished updating board flags in 1.457 seconds
2013-08-13 03:51:42 [INFO    ] __waitForTBW - TBW finished in 220.657 s
2013-08-13 03:51:43 [DEBUG   ] Finished updating ant stats in 0.966 seconds
2013-08-13 03:51:43 [INFO    ] Started antennas statistics background thread
2013-08-13 03:51:43 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376365904']
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376365904']
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376365904']
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376365904']
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376365904']
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376365904']
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376365904']
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376365904']
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376365904']
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376365904']
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376365904']
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376365904']
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376365904']
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376365904']
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376365904']
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376365904']
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376365904']
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376365904']
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376365904']
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376365904']
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376365904']
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376365904']
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376365904']
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376365904']
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376365904']
2013-08-13 03:51:43 [DEBUG   ] spawn_process: at 2013-08-13 03:51:43 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376365904']
2013-08-13 03:51:43 [INFO    ] Finished spawning TBN in 0.045 s
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 81211886
2013-08-13 03:51:54 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767723456000000
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 81172220
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 81215605
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 81204750
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 81215949
2013-08-13 03:51:54 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767723456000000
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 1, top port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 1, bottom port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 5, top port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 5, bottom port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 1, top port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 1, bottom port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 5, bottom port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 1, top port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 1, bottom port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 5, top port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 5, bottom port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 1, top port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 1, bottom port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 5, top port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 5, bottom port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 1, top port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 1, bottom port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 5, top port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 5, bottom port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 1, top port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 1, bottom port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 5, top port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 5, bottom port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 1, top port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 1, bottom port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 5, top port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 5, bottom port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 1, top port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 1, bottom port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 5, top port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 5, bottom port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 1, top port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 1, bottom port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 5, top port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 5, bottom port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 1, top port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 5, top port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 5, bottom port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 1, top port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 1, bottom port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 5, top port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 5, bottom port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, top port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 5, top port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 5, bottom port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 1, top port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 2, top port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 4, bottom port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 98107172
2013-08-13 03:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 5, bottom port
2013-08-13 03:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 81129625
2013-08-13 03:51:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767723652000000
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 81101910
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 81123624
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 81132823
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 81135454
2013-08-13 03:51:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767723652000000
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 1, top port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 1, bottom port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 5, top port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 5, bottom port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 1, top port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 1, bottom port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 5, bottom port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 1, top port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 1, bottom port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 5, top port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 5, bottom port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 1, top port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 1, bottom port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 5, top port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 5, bottom port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 1, top port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 1, bottom port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 5, top port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 5, bottom port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 1, top port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 1, bottom port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 5, top port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 5, bottom port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 1, top port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 1, bottom port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 5, top port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 5, bottom port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 1, top port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 1, bottom port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 5, top port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 5, bottom port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 1, top port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 1, bottom port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 5, top port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 5, bottom port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 1, top port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, top port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 1, top port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 1, bottom port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 5, top port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 5, bottom port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 1, top port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 1, bottom port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 5, top port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 5, bottom port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 1, top port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 2, top port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 4, bottom port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 98107172
2013-08-13 03:51:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 5, bottom port
2013-08-13 03:51:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 98107172
2013-08-13 03:51:55 [CRITICAL] MGT underflow detected on beam(s) 4, 1, 2, 3
2013-08-13 03:51:55 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 03:51:55 [DEBUG   ] Finished updating board flags in 1.597 seconds
2013-08-13 03:52:03 [DEBUG   ] Finished updating ant stats in 0.869 seconds
2013-08-13 03:52:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 03:52:43 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 22998880
2013-08-13 03:52:54 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767735608000000
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 22955159
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 23002806
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 22990300
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 23002268
2013-08-13 03:52:54 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767735608000000
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 1, top port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 1, bottom port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 5, top port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 5, bottom port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 1, top port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 1, bottom port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 5, bottom port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 1, top port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 1, bottom port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 5, top port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 5, bottom port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 1, top port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 1, bottom port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 5, top port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 5, bottom port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 1, top port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 1, bottom port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 5, top port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 5, bottom port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 1, top port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 1, bottom port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 5, top port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 5, bottom port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 1, top port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 1, bottom port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 5, top port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 5, bottom port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 1, top port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 1, bottom port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 5, top port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 5, bottom port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 1, top port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 1, bottom port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 5, top port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 5, bottom port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 1, top port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 5, top port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 5, bottom port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 1, top port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 1, bottom port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 5, top port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 5, bottom port
2013-08-13 03:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 5, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 5, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 1, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 2, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 4, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 5, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 22908569
2013-08-13 03:52:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767735804000000
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 22877985
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 22901094
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 22910856
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 22913834
2013-08-13 03:52:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767735804000000
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 1, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 1, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 5, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 5, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 1, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 1, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 5, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 1, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 1, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 5, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 5, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 1, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 1, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 5, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 5, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 1, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 1, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 5, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 5, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 1, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 1, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 5, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 5, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 1, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 1, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 5, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 5, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 1, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 1, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 5, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 5, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 1, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 1, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 5, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 5, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 1, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 1, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 1, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 5, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 5, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 1, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 1, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 5, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 5, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 1, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 2, top port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 4, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-13 03:52:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 5, bottom port
2013-08-13 03:52:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-13 03:52:55 [CRITICAL] MGT underflow detected on beam(s) 4, 1, 2, 3
2013-08-13 03:52:55 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 03:52:55 [DEBUG   ] Finished updating board flags in 1.519 seconds
2013-08-13 03:53:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 03:53:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 03:53:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 19032989
2013-08-13 03:53:54 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767747564000000
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 18989037
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 19036939
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 19024271
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 19036297
2013-08-13 03:53:54 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767747564000000
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 1, top port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 1, bottom port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 5, top port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 5, bottom port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 1, top port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 1, bottom port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 5, bottom port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 1, top port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 1, bottom port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 5, top port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 5, bottom port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 1, top port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 1, bottom port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 5, top port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 5, bottom port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 1, top port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 1, bottom port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 5, top port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 5, bottom port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 1, top port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 1, bottom port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 5, top port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 5, bottom port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 1, top port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 1, bottom port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 5, top port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 5, bottom port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 1, top port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 1, bottom port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 5, top port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 5, bottom port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 1, top port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 1, bottom port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000009
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 5, top port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 5, bottom port
2013-08-13 03:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 1, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 5, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 5, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 1, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 1, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 5, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 5, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 5, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 5, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 1, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 2, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 4, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 5, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 18942246
2013-08-13 03:53:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767747760000000
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 18911478
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 18934727
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 18944429
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 18947457
2013-08-13 03:53:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767747760000000
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 1, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 1, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 5, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 5, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 1, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 1, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 5, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 1, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 1, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 5, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 5, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 1, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 1, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 5, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 5, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 1, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 1, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 5, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 5, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 1, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 1, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 5, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 5, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 1, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 1, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 5, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 5, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 1, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 1, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 5, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 5, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 1, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 1, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 5, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 5, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 1, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 1, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 1, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 5, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 5, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 1, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 1, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 5, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 5, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 1, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 2, top port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 4, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000009
2013-08-13 03:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 5, bottom port
2013-08-13 03:53:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000009
2013-08-13 03:53:55 [CRITICAL] MGT underflow detected on beam(s) 4, 1, 2, 3
2013-08-13 03:53:55 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 03:53:55 [DEBUG   ] Finished updating board flags in 1.513 seconds
2013-08-13 03:53:58 [DEBUG   ] Got command TBW from MCS: ref #18246
2013-08-13 03:53:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 03:53:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18246   8 56517 14038011 A  ERROR'
2013-08-13 03:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 03:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 03:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 03:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 03:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 03:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 03:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 03:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 03:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 03:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 03:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 03:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 03:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 03:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 03:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 03:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 03:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 03:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 03:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 03:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 03:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 03:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 03:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 03:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 03:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 03:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 03:54:01 [DEBUG   ] Got command RPT from MCS: ref #18248
2013-08-13 03:54:01 [DEBUG   ] summary = ERROR
2013-08-13 03:54:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18248  13 56517 14041323 A  ERRORERROR'
2013-08-13 03:54:01 [DEBUG   ] Got command RPT from MCS: ref #18249
2013-08-13 03:54:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 03:54:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18249  79 56517 14041324 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 03:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 03:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 03:54:01 [DEBUG   ] spawn_process: at 2013-08-13 03:54:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 03:54:01 [INFO    ] Finished spawning TBW
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 3430468
2013-08-13 03:54:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767759912000000
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 3385248
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 3434478
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 3421365
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 3433722
2013-08-13 03:54:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767759912000000
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 1, top port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 1, bottom port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 5, top port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 5, bottom port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 1, top port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 1, bottom port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 5, bottom port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 1, top port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 1, bottom port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 5, top port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 5, bottom port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 1, top port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 1, bottom port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 5, top port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 5, bottom port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 1, top port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 1, bottom port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 5, top port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 5, bottom port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 1, top port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 1, bottom port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 5, top port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 5, bottom port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 1, top port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 1, bottom port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 5, top port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 5, bottom port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 1, top port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 1, bottom port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 5, top port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 5, bottom port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 1, top port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 1, bottom port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 5, top port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 5, bottom port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 1, top port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 5, top port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 5, bottom port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 1, top port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 1, bottom port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 5, top port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 5, bottom port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, top port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 5, top port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 5, bottom port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 1, top port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 2, top port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 4, bottom port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-13 03:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 5, bottom port
2013-08-13 03:54:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 3337607
2013-08-13 03:54:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767760108000000
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 3305895
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 3329765
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 3339683
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 3342699
2013-08-13 03:54:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767760108000000
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 1, top port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 1, bottom port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 5, top port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 5, bottom port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 1, top port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 1, bottom port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 5, bottom port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 1, top port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 1, bottom port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 5, top port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 5, bottom port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 1, top port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 1, bottom port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 5, top port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 5, bottom port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 1, top port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 1, bottom port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 5, top port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 5, bottom port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 1, top port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 1, bottom port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 5, top port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 5, bottom port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 1, top port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 1, bottom port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 5, top port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 5, bottom port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 1, top port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 1, bottom port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 5, top port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 5, bottom port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 1, top port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 1, bottom port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 5, top port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 5, bottom port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 1, top port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, top port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 1, top port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 1, bottom port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 5, top port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 5, bottom port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 1, top port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 1, bottom port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 5, top port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 5, bottom port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 1, top port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 2, top port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 4, bottom port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 5, bottom port
2013-08-13 03:54:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-13 03:54:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 03:54:56 [CRITICAL] MGT underflow detected on beam(s) 4, 1, 2, 3
2013-08-13 03:54:56 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 03:54:56 [DEBUG   ] Finished updating board flags in 2.124 seconds
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255263
2013-08-13 03:55:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767772456000000
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207258
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259247
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244396
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257641
2013-08-13 03:55:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767772456000000
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 1, top port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 1, bottom port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 5, top port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 5, bottom port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 1, top port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 1, bottom port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 5, bottom port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 1, top port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 1, bottom port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 5, top port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 5, bottom port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 1, top port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 1, bottom port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 5, top port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 5, bottom port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 1, top port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 1, bottom port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 5, top port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 5, bottom port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 1, top port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 1, bottom port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 5, top port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 5, bottom port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 1, top port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 1, bottom port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 5, top port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 5, bottom port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 1, top port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 1, bottom port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 5, top port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 5, bottom port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 1, top port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 1, bottom port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 5, top port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 5, bottom port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 1, top port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 5, top port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 5, bottom port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 1, top port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 1, bottom port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 5, top port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 5, bottom port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, top port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 5, top port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 5, bottom port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 1, top port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 2, top port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 4, bottom port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 25631477
2013-08-13 03:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 5, bottom port
2013-08-13 03:55:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157189
2013-08-13 03:55:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767772652000000
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123793
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148612
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158316
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162454
2013-08-13 03:55:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767772652000000
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 1, top port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 1, bottom port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 5, top port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 5, bottom port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 1, top port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 1, bottom port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 5, bottom port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 1, top port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 1, bottom port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 5, top port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 5, bottom port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 1, top port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 1, bottom port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 5, top port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 5, bottom port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 1, top port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 1, bottom port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 5, top port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 5, bottom port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 1, top port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 1, bottom port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 5, top port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 5, bottom port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 1, top port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 1, bottom port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 5, top port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 5, bottom port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 1, top port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 1, bottom port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 5, top port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 5, bottom port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 1, top port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 1, bottom port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 5, top port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 5, bottom port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 1, top port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, top port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 1, top port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 1, bottom port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 5, top port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 5, bottom port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 1, top port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 1, bottom port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 5, top port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 5, bottom port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 1, top port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 2, top port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 4, bottom port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 25631477
2013-08-13 03:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 5, bottom port
2013-08-13 03:55:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 25631477
2013-08-13 03:55:56 [CRITICAL] MGT underflow detected on beam(s) 4, 1, 2, 3
2013-08-13 03:55:56 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 03:55:56 [DEBUG   ] Finished updating board flags in 1.859 seconds
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255273
2013-08-13 03:56:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767784216000000
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207268
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259257
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244406
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257651
2013-08-13 03:56:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767784216000000
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-13 03:56:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157199
2013-08-13 03:56:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767784412000000
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123803
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148622
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158326
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162464
2013-08-13 03:56:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767784412000000
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-13 03:56:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-13 03:56:56 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 03:56:56 [DEBUG   ] Finished updating board flags in 1.939 seconds
2013-08-13 03:57:40 [INFO    ] __waitForTBW - TBW finished in 218.742 s
2013-08-13 03:57:41 [INFO    ] Started antennas statistics background thread
2013-08-13 03:57:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376366262']
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376366262']
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376366262']
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376366262']
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376366262']
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376366262']
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376366262']
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376366262']
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376366262']
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376366262']
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376366262']
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376366262']
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376366262']
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376366262']
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376366262']
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376366262']
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376366262']
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376366262']
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376366262']
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376366262']
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376366262']
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376366262']
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376366262']
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376366262']
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376366262']
2013-08-13 03:57:41 [DEBUG   ] spawn_process: at 2013-08-13 03:57:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376366262']
2013-08-13 03:57:41 [INFO    ] Finished spawning TBN in 0.052 s
2013-08-13 03:57:41 [DEBUG   ] Finished updating ant stats in 1.142 seconds
2013-08-13 03:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255273
2013-08-13 03:57:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767795976000000
2013-08-13 03:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207268
2013-08-13 03:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259257
2013-08-13 03:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244406
2013-08-13 03:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257651
2013-08-13 03:57:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767795976000000
2013-08-13 03:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157199
2013-08-13 03:57:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767796172000000
2013-08-13 03:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123803
2013-08-13 03:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148622
2013-08-13 03:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158326
2013-08-13 03:57:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162464
2013-08-13 03:57:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767796172000000
2013-08-13 03:57:56 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 03:57:56 [DEBUG   ] Finished updating board flags in 1.986 seconds
2013-08-13 03:58:01 [DEBUG   ] Finished updating ant stats in 0.988 seconds
2013-08-13 03:58:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-08-13 03:58:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 03:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255273
2013-08-13 03:58:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767807736000000
2013-08-13 03:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207268
2013-08-13 03:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259257
2013-08-13 03:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244406
2013-08-13 03:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257651
2013-08-13 03:58:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767807736000000
2013-08-13 03:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157199
2013-08-13 03:58:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767807932000000
2013-08-13 03:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123803
2013-08-13 03:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148622
2013-08-13 03:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158326
2013-08-13 03:58:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162464
2013-08-13 03:58:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767807932000000
2013-08-13 03:58:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 03:58:56 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 03:58:56 [DEBUG   ] Finished updating board flags in 1.664 seconds
2013-08-13 03:59:01 [DEBUG   ] Got command RPT from MCS: ref #18265
2013-08-13 03:59:01 [DEBUG   ] summary = ERROR
2013-08-13 03:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18265  13 56517 14341315 A  ERRORERROR'
2013-08-13 03:59:01 [DEBUG   ] Got command RPT from MCS: ref #18266
2013-08-13 03:59:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 03:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18266  79 56517 14341316 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 03:59:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 03:59:21 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2013-08-13 03:59:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-08-13 03:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255273
2013-08-13 03:59:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767819496000000
2013-08-13 03:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207268
2013-08-13 03:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259257
2013-08-13 03:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244406
2013-08-13 03:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257651
2013-08-13 03:59:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767819496000000
2013-08-13 03:59:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157199
2013-08-13 03:59:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767819692000000
2013-08-13 03:59:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123803
2013-08-13 03:59:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148622
2013-08-13 03:59:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158326
2013-08-13 03:59:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162464
2013-08-13 03:59:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767819692000000
2013-08-13 03:59:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 03:59:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 03:59:56 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 03:59:56 [DEBUG   ] Finished updating board flags in 1.608 seconds
2013-08-13 03:59:58 [DEBUG   ] Got command TBW from MCS: ref #18283
2013-08-13 03:59:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 03:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18283   8 56517 14398015 A  ERROR'
2013-08-13 03:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 03:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 03:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 03:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 03:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 04:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 04:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 04:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 04:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 04:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 04:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 04:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 04:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 04:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 04:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 04:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 04:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 04:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 04:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 04:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 04:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 04:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 04:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 04:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 04:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 04:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 04:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 04:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 04:00:01 [DEBUG   ] spawn_process: at 2013-08-13 04:00:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 04:00:01 [INFO    ] Finished spawning TBW
2013-08-13 04:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255273
2013-08-13 04:00:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767831256000000
2013-08-13 04:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207268
2013-08-13 04:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259257
2013-08-13 04:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244406
2013-08-13 04:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257651
2013-08-13 04:00:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767831256000000
2013-08-13 04:00:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157199
2013-08-13 04:00:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767831452000000
2013-08-13 04:00:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123803
2013-08-13 04:00:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148622
2013-08-13 04:00:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158326
2013-08-13 04:00:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162464
2013-08-13 04:00:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767831452000000
2013-08-13 04:00:56 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:00:56 [DEBUG   ] Finished updating board flags in 1.401 seconds
2013-08-13 04:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255273
2013-08-13 04:01:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767843016000000
2013-08-13 04:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207268
2013-08-13 04:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259257
2013-08-13 04:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244406
2013-08-13 04:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257651
2013-08-13 04:01:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767843016000000
2013-08-13 04:01:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157199
2013-08-13 04:01:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767843212000000
2013-08-13 04:01:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123803
2013-08-13 04:01:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148622
2013-08-13 04:01:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158326
2013-08-13 04:01:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162464
2013-08-13 04:01:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767843212000000
2013-08-13 04:01:56 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:01:56 [DEBUG   ] Finished updating board flags in 1.531 seconds
2013-08-13 04:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255273
2013-08-13 04:02:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767854972000000
2013-08-13 04:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207268
2013-08-13 04:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259257
2013-08-13 04:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244406
2013-08-13 04:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257651
2013-08-13 04:02:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767854972000000
2013-08-13 04:02:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157199
2013-08-13 04:02:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767854972000000
2013-08-13 04:02:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123803
2013-08-13 04:02:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148622
2013-08-13 04:02:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158326
2013-08-13 04:02:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162464
2013-08-13 04:02:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767854972000000
2013-08-13 04:02:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 04:02:56 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:02:56 [DEBUG   ] Finished updating board flags in 1.277 seconds
2013-08-13 04:03:40 [INFO    ] __waitForTBW - TBW finished in 218.444 s
2013-08-13 04:03:41 [INFO    ] Started antennas statistics background thread
2013-08-13 04:03:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376366622']
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376366622']
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376366622']
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376366622']
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376366622']
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376366622']
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376366622']
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376366622']
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376366622']
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376366622']
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376366622']
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376366622']
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376366622']
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376366622']
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376366622']
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376366622']
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376366622']
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376366622']
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376366622']
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376366622']
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376366622']
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376366622']
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376366622']
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376366622']
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376366622']
2013-08-13 04:03:41 [DEBUG   ] spawn_process: at 2013-08-13 04:03:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376366622']
2013-08-13 04:03:41 [INFO    ] Finished spawning TBN in 0.052 s
2013-08-13 04:03:41 [DEBUG   ] Finished updating ant stats in 1.273 seconds
2013-08-13 04:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255273
2013-08-13 04:03:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767866732000000
2013-08-13 04:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207268
2013-08-13 04:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259257
2013-08-13 04:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244406
2013-08-13 04:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257651
2013-08-13 04:03:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767866732000000
2013-08-13 04:03:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157199
2013-08-13 04:03:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767866732000000
2013-08-13 04:03:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123803
2013-08-13 04:03:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148622
2013-08-13 04:03:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158326
2013-08-13 04:03:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162464
2013-08-13 04:03:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767866732000000
2013-08-13 04:03:56 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:03:56 [DEBUG   ] Finished updating board flags in 1.504 seconds
2013-08-13 04:04:01 [DEBUG   ] Got command RPT from MCS: ref #18285
2013-08-13 04:04:01 [DEBUG   ] summary = ERROR
2013-08-13 04:04:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18285  13 56517 14641319 A  ERRORERROR'
2013-08-13 04:04:01 [DEBUG   ] Got command RPT from MCS: ref #18286
2013-08-13 04:04:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 04:04:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18286  79 56517 14641320 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 04:04:01 [DEBUG   ] Finished updating ant stats in 1.229 seconds
2013-08-13 04:04:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-08-13 04:04:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 04:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255273
2013-08-13 04:04:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767878492000000
2013-08-13 04:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207268
2013-08-13 04:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259257
2013-08-13 04:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244406
2013-08-13 04:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257651
2013-08-13 04:04:55 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767878492000000
2013-08-13 04:04:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157199
2013-08-13 04:04:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767878688000000
2013-08-13 04:04:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123803
2013-08-13 04:04:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148622
2013-08-13 04:04:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158326
2013-08-13 04:04:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162464
2013-08-13 04:04:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767878688000000
2013-08-13 04:04:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 04:04:56 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:04:56 [DEBUG   ] Finished updating board flags in 1.503 seconds
2013-08-13 04:05:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 04:05:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 04:05:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 04:05:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255273
2013-08-13 04:05:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767890252000000
2013-08-13 04:05:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207268
2013-08-13 04:05:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259257
2013-08-13 04:05:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244406
2013-08-13 04:05:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257651
2013-08-13 04:05:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767890252000000
2013-08-13 04:05:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157199
2013-08-13 04:05:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767890448000000
2013-08-13 04:05:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123803
2013-08-13 04:05:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148622
2013-08-13 04:05:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158326
2013-08-13 04:05:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162464
2013-08-13 04:05:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767890448000000
2013-08-13 04:05:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-08-13 04:05:57 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:05:57 [DEBUG   ] Finished updating board flags in 2.311 seconds
2013-08-13 04:05:58 [DEBUG   ] Got command TBW from MCS: ref #18303
2013-08-13 04:05:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 04:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18303   8 56517 14758015 A  ERROR'
2013-08-13 04:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 04:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 04:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 04:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 04:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 04:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 04:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 04:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 04:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 04:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 04:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 04:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 04:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 04:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 04:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 04:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 04:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 04:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 04:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 04:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 04:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 04:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 04:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 04:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 04:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 04:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 04:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 04:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 04:06:01 [DEBUG   ] spawn_process: at 2013-08-13 04:06:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 04:06:01 [INFO    ] Finished spawning TBW
2013-08-13 04:06:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255273
2013-08-13 04:06:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767902012000000
2013-08-13 04:06:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207268
2013-08-13 04:06:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259257
2013-08-13 04:06:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244406
2013-08-13 04:06:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257651
2013-08-13 04:06:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767902012000000
2013-08-13 04:06:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157199
2013-08-13 04:06:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767902208000000
2013-08-13 04:06:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123803
2013-08-13 04:06:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148622
2013-08-13 04:06:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158326
2013-08-13 04:06:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162464
2013-08-13 04:06:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767902208000000
2013-08-13 04:06:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 04:06:56 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:06:56 [DEBUG   ] Finished updating board flags in 1.365 seconds
2013-08-13 04:07:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255273
2013-08-13 04:07:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767913772000000
2013-08-13 04:07:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207268
2013-08-13 04:07:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259257
2013-08-13 04:07:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244406
2013-08-13 04:07:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257651
2013-08-13 04:07:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767913772000000
2013-08-13 04:07:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157199
2013-08-13 04:07:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767913968000000
2013-08-13 04:07:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123803
2013-08-13 04:07:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148622
2013-08-13 04:07:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158326
2013-08-13 04:07:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162464
2013-08-13 04:07:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767913968000000
2013-08-13 04:07:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 04:07:57 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:07:57 [DEBUG   ] Finished updating board flags in 1.855 seconds
2013-08-13 04:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255273
2013-08-13 04:08:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767925532000000
2013-08-13 04:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207268
2013-08-13 04:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259257
2013-08-13 04:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244406
2013-08-13 04:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257651
2013-08-13 04:08:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767925532000000
2013-08-13 04:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157199
2013-08-13 04:08:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767925728000000
2013-08-13 04:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123803
2013-08-13 04:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148622
2013-08-13 04:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158326
2013-08-13 04:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162464
2013-08-13 04:08:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767925728000000
2013-08-13 04:08:56 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:08:56 [DEBUG   ] Finished updating board flags in 1.125 seconds
2013-08-13 04:09:01 [DEBUG   ] Got command RPT from MCS: ref #18305
2013-08-13 04:09:01 [DEBUG   ] summary = ERROR
2013-08-13 04:09:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18305  13 56517 14941323 A  ERRORERROR'
2013-08-13 04:09:01 [DEBUG   ] Got command RPT from MCS: ref #18306
2013-08-13 04:09:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 04:09:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18306  79 56517 14941323 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 04:09:40 [INFO    ] __waitForTBW - TBW finished in 218.533 s
2013-08-13 04:09:41 [INFO    ] Started antennas statistics background thread
2013-08-13 04:09:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376366982']
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376366982']
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376366982']
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376366982']
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376366982']
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376366982']
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376366982']
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376366982']
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376366982']
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376366982']
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376366982']
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376366982']
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376366982']
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376366982']
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376366982']
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376366982']
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376366982']
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376366982']
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376366982']
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376366982']
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376366982']
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376366982']
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376366982']
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376366982']
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376366982']
2013-08-13 04:09:41 [DEBUG   ] spawn_process: at 2013-08-13 04:09:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376366982']
2013-08-13 04:09:41 [INFO    ] Finished spawning TBN in 0.051 s
2013-08-13 04:09:41 [DEBUG   ] Finished updating ant stats in 1.278 seconds
2013-08-13 04:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255273
2013-08-13 04:09:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767937292000000
2013-08-13 04:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207268
2013-08-13 04:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259257
2013-08-13 04:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244406
2013-08-13 04:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257651
2013-08-13 04:09:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767937292000000
2013-08-13 04:09:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157199
2013-08-13 04:09:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767937488000000
2013-08-13 04:09:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123803
2013-08-13 04:09:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148622
2013-08-13 04:09:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158326
2013-08-13 04:09:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162464
2013-08-13 04:09:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767937488000000
2013-08-13 04:09:57 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:09:57 [DEBUG   ] Finished updating board flags in 1.743 seconds
2013-08-13 04:10:01 [DEBUG   ] Finished updating ant stats in 1.228 seconds
2013-08-13 04:10:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-08-13 04:10:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 04:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255273
2013-08-13 04:10:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767949052000000
2013-08-13 04:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207268
2013-08-13 04:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259257
2013-08-13 04:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244406
2013-08-13 04:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257651
2013-08-13 04:10:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767949052000000
2013-08-13 04:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157199
2013-08-13 04:10:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767949248000000
2013-08-13 04:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123803
2013-08-13 04:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148622
2013-08-13 04:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158326
2013-08-13 04:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162464
2013-08-13 04:10:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767949248000000
2013-08-13 04:10:57 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:10:57 [DEBUG   ] Finished updating board flags in 1.615 seconds
2013-08-13 04:11:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 04:11:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 04:11:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 04:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255273
2013-08-13 04:11:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767960812000000
2013-08-13 04:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207268
2013-08-13 04:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259257
2013-08-13 04:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244406
2013-08-13 04:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257651
2013-08-13 04:11:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767960812000000
2013-08-13 04:11:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157199
2013-08-13 04:11:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767961008000000
2013-08-13 04:11:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123803
2013-08-13 04:11:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148622
2013-08-13 04:11:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158326
2013-08-13 04:11:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162464
2013-08-13 04:11:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767961008000000
2013-08-13 04:11:57 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:11:57 [DEBUG   ] Finished updating board flags in 1.701 seconds
2013-08-13 04:11:58 [DEBUG   ] Got command TBW from MCS: ref #18323
2013-08-13 04:11:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 04:11:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18323   8 56517 15118011 A  ERROR'
2013-08-13 04:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 04:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 04:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 04:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 04:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 04:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 04:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 04:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 04:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 04:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 04:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 04:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 04:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 04:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 04:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 04:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 04:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 04:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 04:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 04:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 04:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 04:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 04:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 04:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 04:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 04:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 04:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 04:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 04:12:01 [DEBUG   ] spawn_process: at 2013-08-13 04:12:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 04:12:01 [INFO    ] Finished spawning TBW
2013-08-13 04:12:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255273
2013-08-13 04:12:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767972768000000
2013-08-13 04:12:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207268
2013-08-13 04:12:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259257
2013-08-13 04:12:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244406
2013-08-13 04:12:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257651
2013-08-13 04:12:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767972768000000
2013-08-13 04:12:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-08-13 04:12:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157199
2013-08-13 04:12:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767972768000000
2013-08-13 04:12:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123803
2013-08-13 04:12:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148622
2013-08-13 04:12:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158326
2013-08-13 04:12:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162464
2013-08-13 04:12:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767972768000000
2013-08-13 04:12:57 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:12:57 [DEBUG   ] Finished updating board flags in 1.312 seconds
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:13:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767984528000000
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:13:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767984528000000
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-08-13 04:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:13:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767984528000000
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:13:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767984528000000
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-08-13 04:13:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-08-13 04:13:57 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:13:57 [DEBUG   ] Finished updating board flags in 1.320 seconds
2013-08-13 04:14:01 [DEBUG   ] Got command RPT from MCS: ref #18325
2013-08-13 04:14:01 [DEBUG   ] summary = ERROR
2013-08-13 04:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18325  13 56517 15241319 A  ERRORERROR'
2013-08-13 04:14:01 [DEBUG   ] Got command RPT from MCS: ref #18326
2013-08-13 04:14:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 04:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18326  79 56517 15241319 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:14:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269767996288000000
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:14:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269767996288000000
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-13 04:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:14:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269767996288000000
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:14:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269767996288000000
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-13 04:14:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-13 04:14:57 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:14:57 [DEBUG   ] Finished updating board flags in 1.220 seconds
2013-08-13 04:15:40 [INFO    ] __waitForTBW - TBW finished in 218.540 s
2013-08-13 04:15:41 [INFO    ] Started antennas statistics background thread
2013-08-13 04:15:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376367342']
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376367342']
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376367342']
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376367342']
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376367342']
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376367342']
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376367342']
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376367342']
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376367342']
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376367342']
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376367342']
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376367342']
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376367342']
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376367342']
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376367342']
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376367342']
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376367342']
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376367342']
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376367342']
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376367342']
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376367342']
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376367342']
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376367342']
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376367342']
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376367342']
2013-08-13 04:15:41 [DEBUG   ] spawn_process: at 2013-08-13 04:15:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376367342']
2013-08-13 04:15:41 [INFO    ] Finished spawning TBN in 0.051 s
2013-08-13 04:15:41 [DEBUG   ] Finished updating ant stats in 1.269 seconds
2013-08-13 04:15:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:15:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768008048000000
2013-08-13 04:15:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:15:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:15:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:15:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:15:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768008048000000
2013-08-13 04:15:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:15:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768008244000000
2013-08-13 04:15:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:15:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:15:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:15:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:15:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768008244000000
2013-08-13 04:15:58 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 04:15:58 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:15:58 [DEBUG   ] Finished updating board flags in 1.633 seconds
2013-08-13 04:16:01 [DEBUG   ] Finished updating ant stats in 1.217 seconds
2013-08-13 04:16:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 04:16:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 04:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:16:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768019808000000
2013-08-13 04:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:16:56 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768019808000000
2013-08-13 04:16:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:16:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768020004000000
2013-08-13 04:16:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:16:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:16:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:16:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:16:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768020004000000
2013-08-13 04:16:58 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:16:58 [DEBUG   ] Finished updating board flags in 1.626 seconds
2013-08-13 04:17:01 [DEBUG   ] Finished updating ant stats in 1.073 seconds
2013-08-13 04:17:21 [DEBUG   ] Finished updating ant stats in 0.929 seconds
2013-08-13 04:17:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 04:17:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:17:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768031568000000
2013-08-13 04:17:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:17:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:17:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:17:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:17:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768031568000000
2013-08-13 04:17:58 [DEBUG   ] Got command TBW from MCS: ref #18343
2013-08-13 04:17:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 04:17:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18343   8 56517 15478011 A  ERROR'
2013-08-13 04:17:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:17:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768031764000000
2013-08-13 04:17:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:17:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:17:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:17:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:17:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768031764000000
2013-08-13 04:17:58 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:17:58 [DEBUG   ] Finished updating board flags in 2.332 seconds
2013-08-13 04:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 04:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 04:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 04:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 04:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 04:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 04:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 04:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 04:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 04:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 04:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 04:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 04:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 04:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 04:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 04:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 04:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 04:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 04:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 04:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 04:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 04:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 04:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 04:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 04:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 04:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 04:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 04:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 04:18:01 [DEBUG   ] spawn_process: at 2013-08-13 04:18:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 04:18:01 [INFO    ] Finished spawning TBW
2013-08-13 04:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:18:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768043328000000
2013-08-13 04:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:18:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768043328000000
2013-08-13 04:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:18:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768043524000000
2013-08-13 04:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:18:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768043524000000
2013-08-13 04:18:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-08-13 04:18:57 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:18:57 [DEBUG   ] Finished updating board flags in 1.322 seconds
2013-08-13 04:19:01 [DEBUG   ] Got command RPT from MCS: ref #18345
2013-08-13 04:19:01 [DEBUG   ] summary = ERROR
2013-08-13 04:19:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18345  13 56517 15541319 A  ERRORERROR'
2013-08-13 04:19:01 [DEBUG   ] Got command RPT from MCS: ref #18346
2013-08-13 04:19:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 04:19:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18346  79 56517 15541319 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 04:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:19:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768055088000000
2013-08-13 04:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:19:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768055088000000
2013-08-13 04:19:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:19:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768055284000000
2013-08-13 04:19:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:19:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:19:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:19:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:19:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768055284000000
2013-08-13 04:19:58 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:19:58 [DEBUG   ] Finished updating board flags in 1.867 seconds
2013-08-13 04:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:20:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768066848000000
2013-08-13 04:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:20:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768066848000000
2013-08-13 04:20:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:20:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768067044000000
2013-08-13 04:20:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:20:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:20:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:20:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:20:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768067044000000
2013-08-13 04:20:58 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:20:58 [DEBUG   ] Finished updating board flags in 1.808 seconds
2013-08-13 04:21:40 [INFO    ] __waitForTBW - TBW finished in 218.515 s
2013-08-13 04:21:41 [INFO    ] Started antennas statistics background thread
2013-08-13 04:21:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376367702']
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376367702']
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376367702']
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376367702']
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376367702']
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376367702']
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376367702']
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376367702']
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376367702']
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376367702']
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376367702']
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376367702']
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376367702']
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376367702']
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376367702']
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376367702']
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376367702']
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376367702']
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376367702']
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376367702']
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376367702']
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376367702']
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376367702']
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376367702']
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376367702']
2013-08-13 04:21:41 [DEBUG   ] spawn_process: at 2013-08-13 04:21:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376367702']
2013-08-13 04:21:41 [INFO    ] Finished spawning TBN in 0.092 s
2013-08-13 04:21:41 [DEBUG   ] Finished updating ant stats in 1.316 seconds
2013-08-13 04:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:21:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768078608000000
2013-08-13 04:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:21:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768078608000000
2013-08-13 04:21:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:21:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768078804000000
2013-08-13 04:21:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:21:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:21:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:21:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:21:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768078804000000
2013-08-13 04:21:58 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:21:58 [DEBUG   ] Finished updating board flags in 2.001 seconds
2013-08-13 04:22:01 [DEBUG   ] Finished updating ant stats in 1.190 seconds
2013-08-13 04:22:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 04:22:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 04:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:22:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768090368000000
2013-08-13 04:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:22:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768090368000000
2013-08-13 04:22:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:22:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768090564000000
2013-08-13 04:22:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:22:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:22:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:22:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:22:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768090564000000
2013-08-13 04:22:58 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:22:58 [DEBUG   ] Finished updating board flags in 1.868 seconds
2013-08-13 04:23:01 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 04:23:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 04:23:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 04:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:23:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768102128000000
2013-08-13 04:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:23:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768102128000000
2013-08-13 04:23:58 [DEBUG   ] Got command TBW from MCS: ref #18363
2013-08-13 04:23:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 04:23:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18363   8 56517 15838011 A  ERROR'
2013-08-13 04:23:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:23:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768102324000000
2013-08-13 04:23:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:23:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:23:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:23:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:23:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768102324000000
2013-08-13 04:23:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-08-13 04:23:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 04:23:58 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:23:58 [DEBUG   ] Finished updating board flags in 1.820 seconds
2013-08-13 04:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 04:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 04:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 04:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 04:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 04:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 04:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 04:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 04:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 04:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 04:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 04:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 04:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 04:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 04:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 04:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 04:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 04:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 04:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 04:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 04:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 04:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 04:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 04:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 04:24:01 [DEBUG   ] Got command RPT from MCS: ref #18365
2013-08-13 04:24:01 [DEBUG   ] summary = ERROR
2013-08-13 04:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18365  13 56517 15841323 A  ERRORERROR'
2013-08-13 04:24:01 [DEBUG   ] Got command RPT from MCS: ref #18366
2013-08-13 04:24:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 04:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18366  79 56517 15841324 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 04:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 04:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 04:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 04:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 04:24:01 [DEBUG   ] spawn_process: at 2013-08-13 04:24:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 04:24:01 [INFO    ] Finished spawning TBW
2013-08-13 04:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:24:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768113888000000
2013-08-13 04:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:24:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768113888000000
2013-08-13 04:24:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:24:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768114084000000
2013-08-13 04:24:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:24:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:24:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:24:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:24:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768114084000000
2013-08-13 04:24:58 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:24:58 [DEBUG   ] Finished updating board flags in 1.588 seconds
2013-08-13 04:25:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:25:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768125648000000
2013-08-13 04:25:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:25:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:25:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:25:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:25:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768125648000000
2013-08-13 04:25:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:25:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768125844000000
2013-08-13 04:25:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:25:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:25:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:25:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:25:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768125844000000
2013-08-13 04:25:58 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:25:58 [DEBUG   ] Finished updating board flags in 1.525 seconds
2013-08-13 04:26:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:26:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768137604000000
2013-08-13 04:26:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:26:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:26:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:26:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:26:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768137604000000
2013-08-13 04:26:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:26:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768137604000000
2013-08-13 04:26:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:26:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:26:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:26:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:26:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768137604000000
2013-08-13 04:26:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 04:26:58 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:26:58 [DEBUG   ] Finished updating board flags in 1.272 seconds
2013-08-13 04:27:39 [INFO    ] __waitForTBW - TBW finished in 218.168 s
2013-08-13 04:27:40 [DEBUG   ] Finished updating ant stats in 0.430 seconds
2013-08-13 04:27:40 [INFO    ] Started antennas statistics background thread
2013-08-13 04:27:40 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376368062']
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376368062']
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376368062']
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376368062']
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376368062']
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376368062']
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376368062']
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376368062']
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376368062']
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376368062']
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376368062']
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376368062']
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376368062']
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376368062']
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376368062']
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376368062']
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376368062']
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376368062']
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376368062']
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376368062']
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376368062']
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376368062']
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376368062']
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376368062']
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376368062']
2013-08-13 04:27:40 [DEBUG   ] spawn_process: at 2013-08-13 04:27:40 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376368062']
2013-08-13 04:27:40 [INFO    ] Finished spawning TBN in 0.044 s
2013-08-13 04:27:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:27:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768149364000000
2013-08-13 04:27:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:27:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:27:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:27:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:27:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768149364000000
2013-08-13 04:27:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:27:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768149364000000
2013-08-13 04:27:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:27:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:27:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:27:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:27:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768149364000000
2013-08-13 04:27:58 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:27:58 [DEBUG   ] Finished updating board flags in 1.487 seconds
2013-08-13 04:28:00 [DEBUG   ] Finished updating ant stats in 0.465 seconds
2013-08-13 04:28:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-08-13 04:28:41 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-08-13 04:28:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:28:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768161124000000
2013-08-13 04:28:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:28:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:28:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:28:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:28:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768161124000000
2013-08-13 04:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:28:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768161320000000
2013-08-13 04:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:28:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768161320000000
2013-08-13 04:28:58 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:28:58 [DEBUG   ] Finished updating board flags in 1.491 seconds
2013-08-13 04:29:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-13 04:29:01 [DEBUG   ] Got command RPT from MCS: ref #18382
2013-08-13 04:29:01 [DEBUG   ] summary = ERROR
2013-08-13 04:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18382  13 56517 16141327 A  ERRORERROR'
2013-08-13 04:29:01 [DEBUG   ] Got command RPT from MCS: ref #18383
2013-08-13 04:29:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 04:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18383  79 56517 16141328 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 04:29:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 04:29:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-13 04:29:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:29:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768172884000000
2013-08-13 04:29:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:29:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:29:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:29:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:29:57 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768172884000000
2013-08-13 04:29:58 [DEBUG   ] Got command TBW from MCS: ref #18400
2013-08-13 04:29:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 04:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18400   8 56517 16198027 A  ERROR'
2013-08-13 04:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:29:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768173080000000
2013-08-13 04:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:29:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768173080000000
2013-08-13 04:29:58 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:29:58 [DEBUG   ] Finished updating board flags in 1.499 seconds
2013-08-13 04:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 04:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 04:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 04:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 04:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 04:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 04:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 04:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 04:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 04:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 04:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 04:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 04:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 04:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 04:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 04:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 04:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 04:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 04:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 04:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 04:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 04:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 04:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 04:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 04:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 04:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 04:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 04:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 04:30:01 [DEBUG   ] spawn_process: at 2013-08-13 04:30:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 04:30:01 [INFO    ] Finished spawning TBW
2013-08-13 04:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:30:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768184644000000
2013-08-13 04:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:30:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768184644000000
2013-08-13 04:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:30:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768184840000000
2013-08-13 04:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:30:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768184840000000
2013-08-13 04:30:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 04:30:59 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:30:59 [DEBUG   ] Finished updating board flags in 2.057 seconds
2013-08-13 04:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:31:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768196404000000
2013-08-13 04:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:31:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768196404000000
2013-08-13 04:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:31:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768196600000000
2013-08-13 04:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:31:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768196600000000
2013-08-13 04:31:58 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:31:58 [DEBUG   ] Finished updating board flags in 1.332 seconds
2013-08-13 04:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:32:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768208164000000
2013-08-13 04:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:32:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768208164000000
2013-08-13 04:32:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:32:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768208360000000
2013-08-13 04:32:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:32:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:32:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:32:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:32:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768208360000000
2013-08-13 04:32:59 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:32:59 [DEBUG   ] Finished updating board flags in 1.866 seconds
2013-08-13 04:33:39 [INFO    ] __waitForTBW - TBW finished in 218.428 s
2013-08-13 04:33:40 [DEBUG   ] Finished updating ant stats in 0.339 seconds
2013-08-13 04:33:40 [INFO    ] Started antennas statistics background thread
2013-08-13 04:33:40 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376368422']
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376368422']
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376368422']
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376368422']
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376368422']
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376368422']
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376368422']
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376368422']
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376368422']
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376368422']
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376368422']
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376368422']
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376368422']
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376368422']
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376368422']
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376368422']
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376368422']
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376368422']
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376368422']
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376368422']
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376368422']
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376368422']
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376368422']
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376368422']
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376368422']
2013-08-13 04:33:40 [DEBUG   ] spawn_process: at 2013-08-13 04:33:40 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376368422']
2013-08-13 04:33:40 [INFO    ] Finished spawning TBN in 0.047 s
2013-08-13 04:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:33:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768219924000000
2013-08-13 04:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:33:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768219924000000
2013-08-13 04:33:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:33:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768220120000000
2013-08-13 04:33:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:33:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:33:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:33:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:33:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768220120000000
2013-08-13 04:33:59 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:33:59 [DEBUG   ] Finished updating board flags in 2.024 seconds
2013-08-13 04:34:01 [DEBUG   ] Finished updating ant stats in 1.271 seconds
2013-08-13 04:34:01 [DEBUG   ] Got command RPT from MCS: ref #18402
2013-08-13 04:34:01 [DEBUG   ] summary = ERROR
2013-08-13 04:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18402  13 56517 16441327 A  ERRORERROR'
2013-08-13 04:34:01 [DEBUG   ] Got command RPT from MCS: ref #18403
2013-08-13 04:34:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 04:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18403  79 56517 16441328 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 04:34:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-13 04:34:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-13 04:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:34:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768231684000000
2013-08-13 04:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:34:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768231684000000
2013-08-13 04:34:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:34:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768231880000000
2013-08-13 04:34:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:34:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:34:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:34:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:34:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768231880000000
2013-08-13 04:34:59 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:34:59 [DEBUG   ] Finished updating board flags in 1.860 seconds
2013-08-13 04:35:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-13 04:35:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-13 04:35:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-13 04:35:58 [DEBUG   ] Got command TBW from MCS: ref #18420
2013-08-13 04:35:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 04:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18420   8 56517 16558019 A  ERROR'
2013-08-13 04:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:35:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768243444000000
2013-08-13 04:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:35:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768243444000000
2013-08-13 04:35:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:35:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768243836000000
2013-08-13 04:35:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:35:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:35:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:35:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:35:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768243836000000
2013-08-13 04:35:59 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:35:59 [DEBUG   ] Finished updating board flags in 2.139 seconds
2013-08-13 04:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 04:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 04:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 04:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 04:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 04:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 04:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 04:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 04:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 04:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 04:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 04:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 04:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 04:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 04:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 04:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 04:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 04:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 04:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 04:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 04:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 04:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 04:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 04:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 04:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 04:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 04:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 04:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 04:36:01 [DEBUG   ] spawn_process: at 2013-08-13 04:36:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 04:36:01 [INFO    ] Finished spawning TBW
2013-08-13 04:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:36:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768255204000000
2013-08-13 04:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:36:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768255204000000
2013-08-13 04:36:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:36:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768255400000000
2013-08-13 04:36:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:36:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:36:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:36:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:36:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768255400000000
2013-08-13 04:36:59 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:36:59 [DEBUG   ] Finished updating board flags in 1.461 seconds
2013-08-13 04:37:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:37:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768266964000000
2013-08-13 04:37:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:37:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:37:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:37:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:37:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768266964000000
2013-08-13 04:37:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2013-08-13 04:37:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:37:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768267160000000
2013-08-13 04:37:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:37:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:37:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:37:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:37:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768267160000000
2013-08-13 04:37:59 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:37:59 [DEBUG   ] Finished updating board flags in 1.528 seconds
2013-08-13 04:38:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:38:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768278920000000
2013-08-13 04:38:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:38:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:38:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:38:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:38:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768278920000000
2013-08-13 04:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:38:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768278920000000
2013-08-13 04:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:38:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768278920000000
2013-08-13 04:38:59 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:38:59 [DEBUG   ] Finished updating board flags in 1.410 seconds
2013-08-13 04:39:01 [DEBUG   ] Got command RPT from MCS: ref #18422
2013-08-13 04:39:01 [DEBUG   ] summary = ERROR
2013-08-13 04:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18422  13 56517 16741323 A  ERRORERROR'
2013-08-13 04:39:01 [DEBUG   ] Got command RPT from MCS: ref #18423
2013-08-13 04:39:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 04:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18423  79 56517 16741323 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 04:39:41 [INFO    ] __waitForTBW - TBW finished in 219.243 s
2013-08-13 04:39:42 [INFO    ] Started antennas statistics background thread
2013-08-13 04:39:42 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376368783']
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376368783']
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376368783']
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376368783']
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376368783']
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376368783']
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376368783']
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376368783']
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376368783']
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376368783']
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376368783']
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376368783']
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376368783']
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376368783']
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376368783']
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376368783']
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376368783']
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376368783']
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376368783']
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376368783']
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376368783']
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376368783']
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376368783']
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376368783']
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376368783']
2013-08-13 04:39:42 [DEBUG   ] spawn_process: at 2013-08-13 04:39:42 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376368783']
2013-08-13 04:39:42 [INFO    ] Finished spawning TBN in 0.051 s
2013-08-13 04:39:42 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2013-08-13 04:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:39:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768290680000000
2013-08-13 04:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:39:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768290680000000
2013-08-13 04:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:39:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768290680000000
2013-08-13 04:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:39:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768290680000000
2013-08-13 04:39:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-08-13 04:39:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 04:39:59 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:39:59 [DEBUG   ] Finished updating board flags in 1.642 seconds
2013-08-13 04:40:02 [DEBUG   ] Finished updating ant stats in 0.985 seconds
2013-08-13 04:40:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 04:40:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 04:40:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:40:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768302440000000
2013-08-13 04:40:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:40:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:40:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:40:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:40:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768302440000000
2013-08-13 04:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:40:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768302440000000
2013-08-13 04:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:40:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768302440000000
2013-08-13 04:40:59 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:40:59 [DEBUG   ] Finished updating board flags in 1.634 seconds
2013-08-13 04:41:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 04:41:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 04:41:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 04:41:58 [DEBUG   ] Got command TBW from MCS: ref #18440
2013-08-13 04:41:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 04:41:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18440   8 56517 16918015 A  ERROR'
2013-08-13 04:41:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:41:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768314200000000
2013-08-13 04:41:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:41:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:41:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:41:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:41:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768314200000000
2013-08-13 04:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:41:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768314200000000
2013-08-13 04:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:41:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768314200000000
2013-08-13 04:41:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 4
2013-08-13 04:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 04:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 04:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 04:41:59 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:41:59 [DEBUG   ] Finished updating board flags in 1.630 seconds
2013-08-13 04:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 04:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 04:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 04:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 04:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 04:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 04:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 04:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 04:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 04:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 04:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 04:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 04:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 04:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 04:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 04:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 04:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 04:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 04:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 04:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 04:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 04:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 04:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 04:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 04:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 04:42:01 [DEBUG   ] spawn_process: at 2013-08-13 04:42:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 04:42:01 [INFO    ] Finished spawning TBW
2013-08-13 04:42:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:42:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768325960000000
2013-08-13 04:42:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:42:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:42:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:42:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:42:58 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768325960000000
2013-08-13 04:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:42:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768325960000000
2013-08-13 04:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:42:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768325960000000
2013-08-13 04:42:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 04:42:59 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:42:59 [DEBUG   ] Finished updating board flags in 1.173 seconds
2013-08-13 04:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:43:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768337720000000
2013-08-13 04:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:43:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768337720000000
2013-08-13 04:44:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:44:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768337916000000
2013-08-13 04:44:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:44:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:44:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:44:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:44:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768337916000000
2013-08-13 04:44:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 04:44:00 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:44:00 [DEBUG   ] Finished updating board flags in 2.120 seconds
2013-08-13 04:44:01 [DEBUG   ] Got command RPT from MCS: ref #18442
2013-08-13 04:44:01 [DEBUG   ] summary = ERROR
2013-08-13 04:44:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18442  13 56517 17041327 A  ERRORERROR'
2013-08-13 04:44:01 [DEBUG   ] Got command RPT from MCS: ref #18443
2013-08-13 04:44:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 04:44:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18443  79 56517 17041327 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 04:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:44:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768349480000000
2013-08-13 04:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:44:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768349480000000
2013-08-13 04:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:44:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768349676000000
2013-08-13 04:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:44:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768349676000000
2013-08-13 04:44:59 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:44:59 [DEBUG   ] Finished updating board flags in 1.344 seconds
2013-08-13 04:45:40 [INFO    ] __waitForTBW - TBW finished in 218.585 s
2013-08-13 04:45:41 [INFO    ] Started antennas statistics background thread
2013-08-13 04:45:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376369142']
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376369142']
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376369142']
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376369142']
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376369142']
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376369142']
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376369142']
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376369142']
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376369142']
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376369142']
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376369142']
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376369142']
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376369142']
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376369142']
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376369142']
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376369142']
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376369142']
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376369142']
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376369142']
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376369142']
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376369142']
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376369142']
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376369142']
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376369142']
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376369142']
2013-08-13 04:45:41 [DEBUG   ] spawn_process: at 2013-08-13 04:45:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376369142']
2013-08-13 04:45:41 [INFO    ] Finished spawning TBN in 0.051 s
2013-08-13 04:45:41 [DEBUG   ] Finished updating ant stats in 1.257 seconds
2013-08-13 04:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:45:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768361240000000
2013-08-13 04:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:45:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768361240000000
2013-08-13 04:45:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-08-13 04:46:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:46:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768361436000000
2013-08-13 04:46:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:46:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:46:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:46:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:46:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768361436000000
2013-08-13 04:46:00 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:46:00 [DEBUG   ] Finished updating board flags in 1.976 seconds
2013-08-13 04:46:01 [DEBUG   ] Finished updating ant stats in 1.187 seconds
2013-08-13 04:46:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 04:46:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 04:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:46:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768373000000000
2013-08-13 04:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:46:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768373000000000
2013-08-13 04:47:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:47:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768373196000000
2013-08-13 04:47:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:47:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:47:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:47:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:47:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768373196000000
2013-08-13 04:47:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 04:47:00 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:47:00 [DEBUG   ] Finished updating board flags in 1.814 seconds
2013-08-13 04:47:01 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-08-13 04:47:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 04:47:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 04:47:58 [DEBUG   ] Got command TBW from MCS: ref #18460
2013-08-13 04:47:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 04:47:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18460   8 56517 17278015 A  ERROR'
2013-08-13 04:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:47:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768384760000000
2013-08-13 04:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:47:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768384760000000
2013-08-13 04:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 04:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 04:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 04:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 04:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 04:48:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:48:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768384956000000
2013-08-13 04:48:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:48:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:48:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:48:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:48:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768384956000000
2013-08-13 04:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 04:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 04:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 04:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 04:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 04:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 04:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 04:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 04:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 04:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 04:48:00 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:48:00 [DEBUG   ] Finished updating board flags in 1.749 seconds
2013-08-13 04:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 04:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 04:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 04:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 04:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 04:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 04:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 04:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 04:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 04:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 04:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 04:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 04:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 04:48:01 [DEBUG   ] spawn_process: at 2013-08-13 04:48:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 04:48:01 [INFO    ] Finished spawning TBW
2013-08-13 04:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:48:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768396520000000
2013-08-13 04:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:48:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768396520000000
2013-08-13 04:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:49:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768396716000000
2013-08-13 04:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:49:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768396716000000
2013-08-13 04:49:00 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:49:00 [DEBUG   ] Finished updating board flags in 1.529 seconds
2013-08-13 04:49:01 [DEBUG   ] Got command RPT from MCS: ref #18462
2013-08-13 04:49:01 [DEBUG   ] summary = ERROR
2013-08-13 04:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18462  13 56517 17341331 A  ERRORERROR'
2013-08-13 04:49:01 [DEBUG   ] Got command RPT from MCS: ref #18463
2013-08-13 04:49:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 04:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18463  79 56517 17341331 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 04:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:49:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768408476000000
2013-08-13 04:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:49:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768408476000000
2013-08-13 04:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:50:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768408476000000
2013-08-13 04:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:50:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768408476000000
2013-08-13 04:50:00 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:50:00 [DEBUG   ] Finished updating board flags in 1.280 seconds
2013-08-13 04:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:50:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768420236000000
2013-08-13 04:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:50:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768420236000000
2013-08-13 04:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:51:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768420236000000
2013-08-13 04:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:51:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768420236000000
2013-08-13 04:51:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 04:51:00 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:51:00 [DEBUG   ] Finished updating board flags in 1.332 seconds
2013-08-13 04:51:40 [INFO    ] __waitForTBW - TBW finished in 218.582 s
2013-08-13 04:51:41 [INFO    ] Started antennas statistics background thread
2013-08-13 04:51:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376369502']
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376369502']
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376369502']
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376369502']
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376369502']
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376369502']
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376369502']
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376369502']
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376369502']
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376369502']
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376369502']
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376369502']
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376369502']
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376369502']
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376369502']
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376369502']
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376369502']
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376369502']
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376369502']
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376369502']
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376369502']
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376369502']
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376369502']
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376369502']
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376369502']
2013-08-13 04:51:41 [DEBUG   ] spawn_process: at 2013-08-13 04:51:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376369502']
2013-08-13 04:51:41 [INFO    ] Finished spawning TBN in 0.050 s
2013-08-13 04:51:41 [DEBUG   ] Finished updating ant stats in 1.255 seconds
2013-08-13 04:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:51:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768431996000000
2013-08-13 04:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:51:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768431996000000
2013-08-13 04:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:52:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768432192000000
2013-08-13 04:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:52:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768432192000000
2013-08-13 04:52:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-08-13 04:52:01 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:52:01 [DEBUG   ] Finished updating board flags in 1.640 seconds
2013-08-13 04:52:01 [DEBUG   ] Finished updating ant stats in 1.187 seconds
2013-08-13 04:52:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 04:52:41 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-08-13 04:52:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:52:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768443756000000
2013-08-13 04:52:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:52:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:52:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:52:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:52:59 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768443756000000
2013-08-13 04:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:53:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768443952000000
2013-08-13 04:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:53:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768443952000000
2013-08-13 04:53:01 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:53:01 [DEBUG   ] Finished updating board flags in 1.663 seconds
2013-08-13 04:53:01 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 04:53:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 04:53:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 04:53:58 [DEBUG   ] Got command TBW from MCS: ref #18480
2013-08-13 04:53:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 04:53:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18480   8 56517 17638015 A  ERROR'
2013-08-13 04:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 04:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 04:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 04:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 04:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:54:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768455516000000
2013-08-13 04:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:54:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768455516000000
2013-08-13 04:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 04:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 04:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 04:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 04:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 04:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 04:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 04:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 04:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 04:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 04:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 04:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:54:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768455712000000
2013-08-13 04:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:54:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768455712000000
2013-08-13 04:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 04:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 04:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 04:54:01 [DEBUG   ] Got command RPT from MCS: ref #18482
2013-08-13 04:54:01 [DEBUG   ] summary = ERROR
2013-08-13 04:54:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18482  13 56517 17641331 A  ERRORERROR'
2013-08-13 04:54:01 [DEBUG   ] Got command RPT from MCS: ref #18483
2013-08-13 04:54:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 04:54:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18483  79 56517 17641332 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 04:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 04:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 04:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 04:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 04:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 04:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 04:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 04:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 04:54:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 04:54:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 04:54:02 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:54:02 [DEBUG   ] Finished updating board flags in 2.688 seconds
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 04:54:02 [DEBUG   ] spawn_process: at 2013-08-13 04:54:02 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 04:54:02 [INFO    ] Finished spawning TBW
2013-08-13 04:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:55:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768467276000000
2013-08-13 04:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:55:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768467276000000
2013-08-13 04:55:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:55:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768467472000000
2013-08-13 04:55:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:55:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:55:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:55:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:55:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768467472000000
2013-08-13 04:55:01 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:55:01 [DEBUG   ] Finished updating board flags in 1.897 seconds
2013-08-13 04:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:56:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768479036000000
2013-08-13 04:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:56:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768479036000000
2013-08-13 04:56:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:56:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768479232000000
2013-08-13 04:56:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:56:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:56:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:56:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:56:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768479232000000
2013-08-13 04:56:01 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:56:01 [DEBUG   ] Finished updating board flags in 1.917 seconds
2013-08-13 04:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:57:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768490796000000
2013-08-13 04:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:57:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768490796000000
2013-08-13 04:57:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:57:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768490992000000
2013-08-13 04:57:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:57:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:57:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:57:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:57:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768490992000000
2013-08-13 04:57:01 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:57:01 [DEBUG   ] Finished updating board flags in 1.673 seconds
2013-08-13 04:57:41 [INFO    ] __waitForTBW - TBW finished in 218.854 s
2013-08-13 04:57:42 [INFO    ] Started antennas statistics background thread
2013-08-13 04:57:42 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376369863']
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376369863']
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376369863']
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376369863']
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376369863']
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376369863']
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376369863']
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376369863']
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376369863']
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376369863']
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376369863']
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376369863']
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376369863']
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376369863']
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376369863']
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376369863']
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376369863']
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376369863']
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376369863']
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376369863']
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376369863']
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376369863']
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376369863']
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376369863']
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376369863']
2013-08-13 04:57:42 [DEBUG   ] spawn_process: at 2013-08-13 04:57:42 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376369863']
2013-08-13 04:57:42 [INFO    ] Finished spawning TBN in 0.050 s
2013-08-13 04:57:42 [DEBUG   ] Finished updating ant stats in 1.270 seconds
2013-08-13 04:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:58:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768502556000000
2013-08-13 04:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:58:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768502556000000
2013-08-13 04:58:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:58:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768502752000000
2013-08-13 04:58:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:58:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:58:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:58:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:58:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768502752000000
2013-08-13 04:58:01 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:58:01 [DEBUG   ] Finished updating board flags in 1.829 seconds
2013-08-13 04:58:02 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2013-08-13 04:58:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 04:58:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 04:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 04:59:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768514316000000
2013-08-13 04:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 04:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 04:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 04:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 04:59:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768514316000000
2013-08-13 04:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 04:59:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768514512000000
2013-08-13 04:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 04:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 04:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 04:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 04:59:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768514512000000
2013-08-13 04:59:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-08-13 04:59:01 [DEBUG   ] Got command RPT from MCS: ref #18499
2013-08-13 04:59:01 [DEBUG   ] summary = ERROR
2013-08-13 04:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18499  13 56517 17941336 A  ERRORERROR'
2013-08-13 04:59:01 [DEBUG   ] Got command RPT from MCS: ref #18500
2013-08-13 04:59:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 04:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18500  79 56517 17941336 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 04:59:01 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 04:59:01 [DEBUG   ] Finished updating board flags in 1.815 seconds
2013-08-13 04:59:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 04:59:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 04:59:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 04:59:58 [DEBUG   ] Got command TBW from MCS: ref #18517
2013-08-13 04:59:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 04:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18517   8 56517 17998011 A  ERROR'
2013-08-13 04:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 04:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 04:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 04:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 05:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:00:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768526076000000
2013-08-13 05:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:00:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768526076000000
2013-08-13 05:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 05:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 05:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 05:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 05:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 05:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 05:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 05:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 05:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 05:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 05:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 05:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 05:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:00:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768526272000000
2013-08-13 05:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:00:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768526272000000
2013-08-13 05:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 05:00:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 05:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 05:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 05:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 05:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 05:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 05:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 05:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 05:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 05:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 05:00:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 05:00:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 05:00:02 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:00:02 [DEBUG   ] Finished updating board flags in 2.418 seconds
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 05:00:02 [DEBUG   ] spawn_process: at 2013-08-13 05:00:02 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 05:00:02 [INFO    ] Finished spawning TBW
2013-08-13 05:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:01:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768537836000000
2013-08-13 05:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:01:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768537836000000
2013-08-13 05:01:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:01:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768538032000000
2013-08-13 05:01:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:01:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:01:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:01:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:01:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768538032000000
2013-08-13 05:01:01 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:01:01 [DEBUG   ] Finished updating board flags in 1.625 seconds
2013-08-13 05:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:02:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768549596000000
2013-08-13 05:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:02:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768549596000000
2013-08-13 05:02:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:02:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768549792000000
2013-08-13 05:02:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:02:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:02:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:02:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:02:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768549792000000
2013-08-13 05:02:01 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:02:01 [DEBUG   ] Finished updating board flags in 1.573 seconds
2013-08-13 05:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:03:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768561356000000
2013-08-13 05:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:03:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768561356000000
2013-08-13 05:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:03:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768561552000000
2013-08-13 05:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:03:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768561552000000
2013-08-13 05:03:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 05:03:01 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:03:01 [DEBUG   ] Finished updating board flags in 1.477 seconds
2013-08-13 05:03:41 [INFO    ] __waitForTBW - TBW finished in 218.863 s
2013-08-13 05:03:42 [INFO    ] Started antennas statistics background thread
2013-08-13 05:03:42 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376370223']
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376370223']
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376370223']
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376370223']
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376370223']
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376370223']
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376370223']
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376370223']
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376370223']
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376370223']
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376370223']
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376370223']
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376370223']
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376370223']
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376370223']
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376370223']
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376370223']
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376370223']
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376370223']
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376370223']
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376370223']
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376370223']
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376370223']
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376370223']
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376370223']
2013-08-13 05:03:42 [DEBUG   ] spawn_process: at 2013-08-13 05:03:42 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376370223']
2013-08-13 05:03:42 [INFO    ] Finished spawning TBN in 0.052 s
2013-08-13 05:03:42 [DEBUG   ] Finished updating ant stats in 1.180 seconds
2013-08-13 05:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:04:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768573312000000
2013-08-13 05:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:04:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768573312000000
2013-08-13 05:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:04:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768573312000000
2013-08-13 05:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:04:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768573312000000
2013-08-13 05:04:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 05:04:01 [DEBUG   ] Got command RPT from MCS: ref #18519
2013-08-13 05:04:01 [DEBUG   ] summary = ERROR
2013-08-13 05:04:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18519  13 56517 18241335 A  ERRORERROR'
2013-08-13 05:04:01 [DEBUG   ] Got command RPT from MCS: ref #18520
2013-08-13 05:04:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 05:04:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18520  79 56517 18241335 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 05:04:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 05:04:01 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:04:01 [DEBUG   ] Finished updating board flags in 1.640 seconds
2013-08-13 05:04:02 [DEBUG   ] Finished updating ant stats in 0.977 seconds
2013-08-13 05:04:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 05:04:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 05:05:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:05:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768585072000000
2013-08-13 05:05:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:05:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:05:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:05:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:05:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768585072000000
2013-08-13 05:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:05:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768585072000000
2013-08-13 05:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:05:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768585072000000
2013-08-13 05:05:01 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:05:01 [DEBUG   ] Finished updating board flags in 1.667 seconds
2013-08-13 05:05:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 05:05:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 05:05:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 05:05:58 [DEBUG   ] Got command TBW from MCS: ref #18537
2013-08-13 05:05:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 05:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18537   8 56517 18358015 A  ERROR'
2013-08-13 05:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 05:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 05:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 05:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 05:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 05:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 05:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 05:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 05:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 05:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 05:06:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:06:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768596832000000
2013-08-13 05:06:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:06:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:06:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:06:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:06:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768596832000000
2013-08-13 05:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 05:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 05:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 05:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 05:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 05:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 05:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 05:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 05:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 05:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 05:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 05:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:06:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768596832000000
2013-08-13 05:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:06:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768596832000000
2013-08-13 05:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 05:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 05:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 05:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 05:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 05:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 05:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 05:06:01 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:06:01 [DEBUG   ] Finished updating board flags in 1.357 seconds
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 05:06:01 [DEBUG   ] spawn_process: at 2013-08-13 05:06:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 05:06:01 [INFO    ] Finished spawning TBW
2013-08-13 05:07:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:07:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768608592000000
2013-08-13 05:07:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:07:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:07:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:07:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:07:00 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768608592000000
2013-08-13 05:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:07:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768608592000000
2013-08-13 05:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:07:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768608592000000
2013-08-13 05:07:01 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:07:01 [DEBUG   ] Finished updating board flags in 1.040 seconds
2013-08-13 05:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:08:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768620352000000
2013-08-13 05:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:08:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768620352000000
2013-08-13 05:08:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:08:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768620548000000
2013-08-13 05:08:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:08:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:08:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:08:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:08:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768620548000000
2013-08-13 05:08:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-08-13 05:08:02 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:08:02 [DEBUG   ] Finished updating board flags in 2.104 seconds
2013-08-13 05:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:09:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768632112000000
2013-08-13 05:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:09:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768632112000000
2013-08-13 05:09:01 [DEBUG   ] Got command RPT from MCS: ref #18539
2013-08-13 05:09:01 [DEBUG   ] summary = ERROR
2013-08-13 05:09:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18539  13 56517 18541331 A  ERRORERROR'
2013-08-13 05:09:01 [DEBUG   ] Got command RPT from MCS: ref #18540
2013-08-13 05:09:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 05:09:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18540  79 56517 18541331 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 05:09:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:09:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768632308000000
2013-08-13 05:09:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:09:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:09:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:09:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:09:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768632308000000
2013-08-13 05:09:02 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:09:02 [DEBUG   ] Finished updating board flags in 1.873 seconds
2013-08-13 05:09:40 [INFO    ] __waitForTBW - TBW finished in 218.590 s
2013-08-13 05:09:41 [DEBUG   ] Finished updating ant stats in 0.977 seconds
2013-08-13 05:09:41 [INFO    ] Started antennas statistics background thread
2013-08-13 05:09:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376370582']
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376370582']
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376370582']
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376370582']
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376370582']
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376370582']
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376370582']
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376370582']
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376370582']
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376370582']
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376370582']
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376370582']
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376370582']
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376370582']
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376370582']
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376370582']
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376370582']
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376370582']
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376370582']
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376370582']
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376370582']
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376370582']
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376370582']
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376370582']
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376370582']
2013-08-13 05:09:41 [DEBUG   ] spawn_process: at 2013-08-13 05:09:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376370582']
2013-08-13 05:09:41 [INFO    ] Finished spawning TBN in 0.049 s
2013-08-13 05:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:10:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768643872000000
2013-08-13 05:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:10:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768643872000000
2013-08-13 05:10:01 [DEBUG   ] Finished updating ant stats in 0.920 seconds
2013-08-13 05:10:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:10:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768644068000000
2013-08-13 05:10:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:10:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:10:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:10:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:10:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768644068000000
2013-08-13 05:10:02 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:10:02 [DEBUG   ] Finished updating board flags in 2.010 seconds
2013-08-13 05:10:21 [DEBUG   ] Finished updating ant stats in 0.751 seconds
2013-08-13 05:10:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 05:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:11:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768655632000000
2013-08-13 05:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:11:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768655632000000
2013-08-13 05:11:01 [DEBUG   ] Finished updating ant stats in 0.651 seconds
2013-08-13 05:11:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:11:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768655828000000
2013-08-13 05:11:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:11:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:11:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:11:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:11:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768655828000000
2013-08-13 05:11:02 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:11:02 [DEBUG   ] Finished updating board flags in 2.005 seconds
2013-08-13 05:11:21 [DEBUG   ] Finished updating ant stats in 0.553 seconds
2013-08-13 05:11:42 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-08-13 05:11:58 [DEBUG   ] Got command TBW from MCS: ref #18557
2013-08-13 05:11:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 05:11:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18557   8 56517 18718015 A  ERROR'
2013-08-13 05:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 05:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 05:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 05:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 05:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 05:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 05:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 05:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 05:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 05:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 05:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 05:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 05:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 05:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 05:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 05:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 05:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 05:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 05:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 05:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 05:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 05:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:12:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768667392000000
2013-08-13 05:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:12:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768667392000000
2013-08-13 05:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 05:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 05:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 05:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 05:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 05:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 05:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 05:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:12:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768667588000000
2013-08-13 05:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:12:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768667588000000
2013-08-13 05:12:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 05:12:01 [DEBUG   ] spawn_process: at 2013-08-13 05:12:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 05:12:01 [INFO    ] Finished spawning TBW
2013-08-13 05:12:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 05:12:01 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:12:01 [DEBUG   ] Finished updating board flags in 1.243 seconds
2013-08-13 05:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:13:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768679152000000
2013-08-13 05:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:13:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768679152000000
2013-08-13 05:13:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:13:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768679348000000
2013-08-13 05:13:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:13:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:13:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:13:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:13:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768679348000000
2013-08-13 05:13:02 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:13:02 [DEBUG   ] Finished updating board flags in 1.886 seconds
2013-08-13 05:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:14:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768690912000000
2013-08-13 05:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:14:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768690912000000
2013-08-13 05:14:01 [DEBUG   ] Got command RPT from MCS: ref #18559
2013-08-13 05:14:01 [DEBUG   ] summary = ERROR
2013-08-13 05:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18559  13 56517 18841331 A  ERRORERROR'
2013-08-13 05:14:01 [DEBUG   ] Got command RPT from MCS: ref #18560
2013-08-13 05:14:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 05:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18560  79 56517 18841332 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 05:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:14:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768691108000000
2013-08-13 05:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:14:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768691108000000
2013-08-13 05:14:01 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:14:01 [DEBUG   ] Finished updating board flags in 1.131 seconds
2013-08-13 05:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:15:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768702672000000
2013-08-13 05:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:15:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768702672000000
2013-08-13 05:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:15:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768702868000000
2013-08-13 05:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:15:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768702868000000
2013-08-13 05:15:02 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:15:02 [DEBUG   ] Finished updating board flags in 1.668 seconds
2013-08-13 05:15:39 [INFO    ] __waitForTBW - TBW finished in 218.479 s
2013-08-13 05:15:40 [INFO    ] Started antennas statistics background thread
2013-08-13 05:15:40 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 05:15:40 [DEBUG   ] spawn_process: at 2013-08-13 05:15:40 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376370942']
2013-08-13 05:15:40 [DEBUG   ] spawn_process: at 2013-08-13 05:15:40 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376370942']
2013-08-13 05:15:41 [DEBUG   ] spawn_process: at 2013-08-13 05:15:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376370942']
2013-08-13 05:15:41 [DEBUG   ] spawn_process: at 2013-08-13 05:15:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376370942']
2013-08-13 05:15:41 [DEBUG   ] spawn_process: at 2013-08-13 05:15:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376370942']
2013-08-13 05:15:41 [DEBUG   ] spawn_process: at 2013-08-13 05:15:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376370942']
2013-08-13 05:15:41 [DEBUG   ] spawn_process: at 2013-08-13 05:15:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376370942']
2013-08-13 05:15:41 [DEBUG   ] spawn_process: at 2013-08-13 05:15:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376370942']
2013-08-13 05:15:41 [DEBUG   ] spawn_process: at 2013-08-13 05:15:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376370942']
2013-08-13 05:15:41 [DEBUG   ] spawn_process: at 2013-08-13 05:15:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376370942']
2013-08-13 05:15:41 [DEBUG   ] spawn_process: at 2013-08-13 05:15:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376370942']
2013-08-13 05:15:41 [DEBUG   ] spawn_process: at 2013-08-13 05:15:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376370942']
2013-08-13 05:15:41 [DEBUG   ] spawn_process: at 2013-08-13 05:15:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376370942']
2013-08-13 05:15:41 [DEBUG   ] spawn_process: at 2013-08-13 05:15:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376370942']
2013-08-13 05:15:41 [DEBUG   ] spawn_process: at 2013-08-13 05:15:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376370942']
2013-08-13 05:15:41 [DEBUG   ] spawn_process: at 2013-08-13 05:15:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376370942']
2013-08-13 05:15:41 [DEBUG   ] spawn_process: at 2013-08-13 05:15:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376370942']
2013-08-13 05:15:41 [DEBUG   ] spawn_process: at 2013-08-13 05:15:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376370942']
2013-08-13 05:15:41 [DEBUG   ] spawn_process: at 2013-08-13 05:15:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376370942']
2013-08-13 05:15:41 [DEBUG   ] spawn_process: at 2013-08-13 05:15:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376370942']
2013-08-13 05:15:41 [DEBUG   ] spawn_process: at 2013-08-13 05:15:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376370942']
2013-08-13 05:15:41 [DEBUG   ] spawn_process: at 2013-08-13 05:15:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376370942']
2013-08-13 05:15:41 [DEBUG   ] spawn_process: at 2013-08-13 05:15:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376370942']
2013-08-13 05:15:41 [DEBUG   ] spawn_process: at 2013-08-13 05:15:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376370942']
2013-08-13 05:15:41 [DEBUG   ] spawn_process: at 2013-08-13 05:15:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376370942']
2013-08-13 05:15:41 [DEBUG   ] spawn_process: at 2013-08-13 05:15:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376370942']
2013-08-13 05:15:41 [INFO    ] Finished spawning TBN in 0.050 s
2013-08-13 05:15:41 [DEBUG   ] Finished updating ant stats in 1.269 seconds
2013-08-13 05:16:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:16:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768714432000000
2013-08-13 05:16:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:16:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:16:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:16:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:16:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768714432000000
2013-08-13 05:16:01 [DEBUG   ] Finished updating ant stats in 1.321 seconds
2013-08-13 05:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:16:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768714628000000
2013-08-13 05:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:16:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768714628000000
2013-08-13 05:16:02 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:16:02 [DEBUG   ] Finished updating board flags in 1.820 seconds
2013-08-13 05:16:21 [DEBUG   ] Finished updating ant stats in 1.143 seconds
2013-08-13 05:16:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 05:17:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:17:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768726192000000
2013-08-13 05:17:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:17:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:17:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:17:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:17:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768726192000000
2013-08-13 05:17:01 [DEBUG   ] Finished updating ant stats in 1.130 seconds
2013-08-13 05:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:17:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768726388000000
2013-08-13 05:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:17:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768726388000000
2013-08-13 05:17:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 05:17:02 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:17:02 [DEBUG   ] Finished updating board flags in 1.861 seconds
2013-08-13 05:17:21 [DEBUG   ] Finished updating ant stats in 0.873 seconds
2013-08-13 05:17:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 05:17:58 [DEBUG   ] Got command TBW from MCS: ref #18577
2013-08-13 05:17:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 05:17:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18577   8 56517 19078019 A  ERROR'
2013-08-13 05:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 05:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 05:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 05:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 05:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 05:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 05:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 05:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 05:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 05:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 05:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 05:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 05:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 05:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 05:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 05:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 05:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 05:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 05:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 05:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 05:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 05:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 05:18:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:18:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768737952000000
2013-08-13 05:18:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:18:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:18:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:18:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:18:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768737952000000
2013-08-13 05:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 05:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 05:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 05:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 05:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 05:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 05:18:01 [DEBUG   ] spawn_process: at 2013-08-13 05:18:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 05:18:01 [INFO    ] Finished spawning TBW
2013-08-13 05:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:18:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768738148000000
2013-08-13 05:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:18:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768738148000000
2013-08-13 05:18:02 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:18:02 [DEBUG   ] Finished updating board flags in 1.401 seconds
2013-08-13 05:19:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:19:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768749712000000
2013-08-13 05:19:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:19:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:19:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:19:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:19:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768749712000000
2013-08-13 05:19:01 [DEBUG   ] Got command RPT from MCS: ref #18579
2013-08-13 05:19:01 [DEBUG   ] summary = ERROR
2013-08-13 05:19:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18579  13 56517 19141335 A  ERRORERROR'
2013-08-13 05:19:01 [DEBUG   ] Got command RPT from MCS: ref #18580
2013-08-13 05:19:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 05:19:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18580  79 56517 19141335 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 05:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:19:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768749908000000
2013-08-13 05:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:19:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768749908000000
2013-08-13 05:19:02 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:19:02 [DEBUG   ] Finished updating board flags in 1.524 seconds
2013-08-13 05:20:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:20:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768761668000000
2013-08-13 05:20:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:20:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:20:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:20:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:20:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768761668000000
2013-08-13 05:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:20:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768761668000000
2013-08-13 05:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:20:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768761668000000
2013-08-13 05:20:02 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:20:02 [DEBUG   ] Finished updating board flags in 1.273 seconds
2013-08-13 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:21:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768773428000000
2013-08-13 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:21:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768773428000000
2013-08-13 05:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:21:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768773428000000
2013-08-13 05:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:21:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768773428000000
2013-08-13 05:21:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 05:21:02 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:21:02 [DEBUG   ] Finished updating board flags in 1.330 seconds
2013-08-13 05:21:39 [INFO    ] __waitForTBW - TBW finished in 218.412 s
2013-08-13 05:21:40 [DEBUG   ] Finished updating ant stats in 0.341 seconds
2013-08-13 05:21:40 [INFO    ] Started antennas statistics background thread
2013-08-13 05:21:40 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376371302']
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376371302']
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376371302']
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376371302']
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376371302']
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376371302']
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376371302']
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376371302']
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376371302']
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376371302']
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376371302']
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376371302']
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376371302']
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376371302']
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376371302']
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376371302']
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376371302']
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376371302']
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376371302']
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376371302']
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376371302']
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376371302']
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376371302']
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376371302']
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376371302']
2013-08-13 05:21:40 [DEBUG   ] spawn_process: at 2013-08-13 05:21:40 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376371302']
2013-08-13 05:21:40 [INFO    ] Finished spawning TBN in 0.047 s
2013-08-13 05:22:01 [DEBUG   ] Finished updating ant stats in 1.270 seconds
2013-08-13 05:22:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:22:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768785188000000
2013-08-13 05:22:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:22:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:22:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:22:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:22:01 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768785188000000
2013-08-13 05:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:22:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768785384000000
2013-08-13 05:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:22:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768785384000000
2013-08-13 05:22:03 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:22:03 [DEBUG   ] Finished updating board flags in 1.677 seconds
2013-08-13 05:22:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-13 05:22:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 05:23:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-13 05:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:23:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768796948000000
2013-08-13 05:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:23:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768796948000000
2013-08-13 05:23:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:23:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768797144000000
2013-08-13 05:23:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:23:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:23:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:23:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:23:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768797144000000
2013-08-13 05:23:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 05:23:03 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:23:03 [DEBUG   ] Finished updating board flags in 2.343 seconds
2013-08-13 05:23:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 05:23:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-13 05:23:58 [DEBUG   ] Got command TBW from MCS: ref #18597
2013-08-13 05:23:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 05:23:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18597   8 56517 19438011 A  ERROR'
2013-08-13 05:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 05:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 05:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 05:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 05:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 05:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 05:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 05:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 05:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 05:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 05:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 05:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 05:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 05:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 05:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 05:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 05:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 05:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 05:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 05:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 05:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 05:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 05:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 05:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 05:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 05:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 05:24:01 [DEBUG   ] Got command RPT from MCS: ref #18599
2013-08-13 05:24:01 [DEBUG   ] summary = ERROR
2013-08-13 05:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18599  13 56517 19441335 A  ERRORERROR'
2013-08-13 05:24:01 [DEBUG   ] Got command RPT from MCS: ref #18600
2013-08-13 05:24:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 05:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18600  79 56517 19441335 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 05:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 05:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 05:24:01 [DEBUG   ] spawn_process: at 2013-08-13 05:24:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 05:24:01 [INFO    ] Finished spawning TBW
2013-08-13 05:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:24:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768808708000000
2013-08-13 05:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:24:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768808708000000
2013-08-13 05:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:24:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768808904000000
2013-08-13 05:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:24:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768808904000000
2013-08-13 05:24:02 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:24:02 [DEBUG   ] Finished updating board flags in 1.331 seconds
2013-08-13 05:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:25:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768820468000000
2013-08-13 05:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:25:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768820468000000
2013-08-13 05:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:25:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768820664000000
2013-08-13 05:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:25:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768820664000000
2013-08-13 05:25:03 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:25:03 [DEBUG   ] Finished updating board flags in 1.856 seconds
2013-08-13 05:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:26:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768832228000000
2013-08-13 05:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:26:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768832228000000
2013-08-13 05:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:26:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768832424000000
2013-08-13 05:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:26:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768832424000000
2013-08-13 05:26:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 05:26:02 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:26:02 [DEBUG   ] Finished updating board flags in 1.135 seconds
2013-08-13 05:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:27:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768843988000000
2013-08-13 05:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:27:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768843988000000
2013-08-13 05:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:27:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768844184000000
2013-08-13 05:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:27:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768844184000000
2013-08-13 05:27:03 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:27:03 [DEBUG   ] Finished updating board flags in 1.666 seconds
2013-08-13 05:27:40 [INFO    ] __waitForTBW - TBW finished in 218.632 s
2013-08-13 05:27:41 [INFO    ] Started antennas statistics background thread
2013-08-13 05:27:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376371662']
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376371662']
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376371662']
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376371662']
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376371662']
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376371662']
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376371662']
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376371662']
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376371662']
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376371662']
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376371662']
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376371662']
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376371662']
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376371662']
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376371662']
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376371662']
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376371662']
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376371662']
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376371662']
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376371662']
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376371662']
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376371662']
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376371662']
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376371662']
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376371662']
2013-08-13 05:27:41 [DEBUG   ] spawn_process: at 2013-08-13 05:27:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376371662']
2013-08-13 05:27:41 [INFO    ] Finished spawning TBN in 0.052 s
2013-08-13 05:27:41 [DEBUG   ] Finished updating ant stats in 1.222 seconds
2013-08-13 05:28:01 [DEBUG   ] Finished updating ant stats in 1.187 seconds
2013-08-13 05:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:28:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768855748000000
2013-08-13 05:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:28:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768855748000000
2013-08-13 05:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:28:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768855944000000
2013-08-13 05:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:28:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768855944000000
2013-08-13 05:28:03 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:28:03 [DEBUG   ] Finished updating board flags in 1.818 seconds
2013-08-13 05:28:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 05:28:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 05:29:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 05:29:01 [DEBUG   ] Got command RPT from MCS: ref #18616
2013-08-13 05:29:01 [DEBUG   ] summary = ERROR
2013-08-13 05:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18616  13 56517 19741335 A  ERRORERROR'
2013-08-13 05:29:01 [DEBUG   ] Got command RPT from MCS: ref #18617
2013-08-13 05:29:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 05:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18617  79 56517 19741335 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 05:29:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:29:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768867508000000
2013-08-13 05:29:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:29:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:29:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:29:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:29:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768867508000000
2013-08-13 05:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:29:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768867704000000
2013-08-13 05:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:29:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768867704000000
2013-08-13 05:29:03 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:29:03 [DEBUG   ] Finished updating board flags in 1.664 seconds
2013-08-13 05:29:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 05:29:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 05:29:58 [DEBUG   ] Got command TBW from MCS: ref #18634
2013-08-13 05:29:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 05:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18634   8 56517 19798015 A  ERROR'
2013-08-13 05:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 05:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 05:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 05:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 05:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 05:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 05:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 05:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 05:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 05:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 05:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 05:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 05:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 05:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 05:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 05:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 05:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 05:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 05:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 05:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 05:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 05:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 05:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 05:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 05:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 05:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 05:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 05:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 05:30:01 [DEBUG   ] spawn_process: at 2013-08-13 05:30:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 05:30:01 [INFO    ] Finished spawning TBW
2013-08-13 05:30:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:30:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768879268000000
2013-08-13 05:30:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:30:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:30:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:30:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:30:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768879268000000
2013-08-13 05:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:30:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768879464000000
2013-08-13 05:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:30:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768879464000000
2013-08-13 05:30:03 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:30:03 [DEBUG   ] Finished updating board flags in 1.407 seconds
2013-08-13 05:31:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:31:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768891028000000
2013-08-13 05:31:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:31:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:31:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:31:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:31:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768891028000000
2013-08-13 05:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:31:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768891224000000
2013-08-13 05:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:31:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768891224000000
2013-08-13 05:31:03 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:31:03 [DEBUG   ] Finished updating board flags in 1.528 seconds
2013-08-13 05:32:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:32:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768902984000000
2013-08-13 05:32:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:32:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:32:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:32:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:32:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768902984000000
2013-08-13 05:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:32:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768902984000000
2013-08-13 05:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:32:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768902984000000
2013-08-13 05:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-08-13 05:32:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 05:32:03 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:32:03 [DEBUG   ] Finished updating board flags in 1.275 seconds
2013-08-13 05:33:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:33:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768914744000000
2013-08-13 05:33:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:33:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:33:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:33:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:33:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768914744000000
2013-08-13 05:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:33:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768914744000000
2013-08-13 05:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:33:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768914744000000
2013-08-13 05:33:03 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:33:03 [DEBUG   ] Finished updating board flags in 1.327 seconds
2013-08-13 05:33:40 [INFO    ] __waitForTBW - TBW finished in 218.646 s
2013-08-13 05:33:41 [INFO    ] Started antennas statistics background thread
2013-08-13 05:33:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376372022']
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376372022']
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376372022']
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376372022']
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376372022']
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376372022']
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376372022']
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376372022']
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376372022']
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376372022']
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376372022']
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376372022']
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376372022']
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376372022']
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376372022']
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376372022']
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376372022']
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376372022']
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376372022']
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376372022']
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376372022']
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376372022']
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376372022']
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376372022']
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376372022']
2013-08-13 05:33:41 [DEBUG   ] spawn_process: at 2013-08-13 05:33:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376372022']
2013-08-13 05:33:41 [INFO    ] Finished spawning TBN in 0.051 s
2013-08-13 05:33:41 [DEBUG   ] Finished updating ant stats in 1.189 seconds
2013-08-13 05:34:01 [DEBUG   ] Finished updating ant stats in 0.988 seconds
2013-08-13 05:34:01 [DEBUG   ] Got command RPT from MCS: ref #18636
2013-08-13 05:34:01 [DEBUG   ] summary = ERROR
2013-08-13 05:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18636  13 56517 20041335 A  ERRORERROR'
2013-08-13 05:34:01 [DEBUG   ] Got command RPT from MCS: ref #18637
2013-08-13 05:34:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 05:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18637  79 56517 20041335 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 05:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:34:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768926504000000
2013-08-13 05:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:34:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768926504000000
2013-08-13 05:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:34:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768926700000000
2013-08-13 05:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:34:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768926700000000
2013-08-13 05:34:04 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:34:04 [DEBUG   ] Finished updating board flags in 1.648 seconds
2013-08-13 05:34:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-08-13 05:34:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 05:35:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-13 05:35:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:35:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768938264000000
2013-08-13 05:35:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:35:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:35:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:35:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:35:02 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768938264000000
2013-08-13 05:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:35:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768938460000000
2013-08-13 05:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:35:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768938460000000
2013-08-13 05:35:04 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:35:04 [DEBUG   ] Finished updating board flags in 1.632 seconds
2013-08-13 05:35:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-13 05:35:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-13 05:35:58 [DEBUG   ] Got command TBW from MCS: ref #18654
2013-08-13 05:35:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 05:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18654   8 56517 20158015 A  ERROR'
2013-08-13 05:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 05:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 05:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 05:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 05:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 05:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 05:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 05:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 05:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 05:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 05:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 05:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 05:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 05:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 05:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 05:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 05:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 05:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 05:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 05:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 05:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 05:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 05:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 05:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 05:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 05:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 05:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 05:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 05:36:01 [DEBUG   ] spawn_process: at 2013-08-13 05:36:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 05:36:01 [INFO    ] Finished spawning TBW
2013-08-13 05:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:36:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768950024000000
2013-08-13 05:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:36:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768950024000000
2013-08-13 05:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:36:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768950220000000
2013-08-13 05:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:36:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768950220000000
2013-08-13 05:36:04 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:36:04 [DEBUG   ] Finished updating board flags in 2.118 seconds
2013-08-13 05:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:37:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768961784000000
2013-08-13 05:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:37:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768961784000000
2013-08-13 05:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:37:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768961980000000
2013-08-13 05:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:37:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768961980000000
2013-08-13 05:37:03 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:37:03 [DEBUG   ] Finished updating board flags in 1.345 seconds
2013-08-13 05:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:38:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768973544000000
2013-08-13 05:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:38:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768973544000000
2013-08-13 05:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:38:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768973740000000
2013-08-13 05:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:38:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768973740000000
2013-08-13 05:38:04 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:38:04 [DEBUG   ] Finished updating board flags in 1.853 seconds
2013-08-13 05:39:01 [DEBUG   ] Got command RPT from MCS: ref #18656
2013-08-13 05:39:01 [DEBUG   ] summary = ERROR
2013-08-13 05:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18656  13 56517 20341339 A  ERRORERROR'
2013-08-13 05:39:01 [DEBUG   ] Got command RPT from MCS: ref #18657
2013-08-13 05:39:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 05:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18657  79 56517 20341340 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 05:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:39:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768985304000000
2013-08-13 05:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:39:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768985304000000
2013-08-13 05:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:39:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768985500000000
2013-08-13 05:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:39:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768985500000000
2013-08-13 05:39:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 05:39:04 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:39:04 [DEBUG   ] Finished updating board flags in 1.815 seconds
2013-08-13 05:39:40 [INFO    ] __waitForTBW - TBW finished in 218.486 s
2013-08-13 05:39:41 [INFO    ] Started antennas statistics background thread
2013-08-13 05:39:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376372382']
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376372382']
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376372382']
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376372382']
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376372382']
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376372382']
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376372382']
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376372382']
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376372382']
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376372382']
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376372382']
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376372382']
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376372382']
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376372382']
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376372382']
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376372382']
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376372382']
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376372382']
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376372382']
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376372382']
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376372382']
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376372382']
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376372382']
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376372382']
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376372382']
2013-08-13 05:39:41 [DEBUG   ] spawn_process: at 2013-08-13 05:39:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376372382']
2013-08-13 05:39:41 [INFO    ] Finished spawning TBN in 0.053 s
2013-08-13 05:39:41 [DEBUG   ] Finished updating ant stats in 1.273 seconds
2013-08-13 05:40:01 [DEBUG   ] Finished updating ant stats in 1.252 seconds
2013-08-13 05:40:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:40:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269768997064000000
2013-08-13 05:40:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:40:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:40:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:40:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:40:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269768997064000000
2013-08-13 05:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:40:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269768997260000000
2013-08-13 05:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:40:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269768997260000000
2013-08-13 05:40:04 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:40:04 [DEBUG   ] Finished updating board flags in 2.003 seconds
2013-08-13 05:40:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-13 05:40:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 05:41:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-13 05:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:41:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769008824000000
2013-08-13 05:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:41:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769008824000000
2013-08-13 05:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:41:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769009020000000
2013-08-13 05:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:41:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769009020000000
2013-08-13 05:41:04 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:41:04 [DEBUG   ] Finished updating board flags in 2.007 seconds
2013-08-13 05:41:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 05:41:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-13 05:41:58 [DEBUG   ] Got command TBW from MCS: ref #18674
2013-08-13 05:41:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 05:41:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18674   8 56517 20518011 A  ERROR'
2013-08-13 05:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 05:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 05:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 05:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 05:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 05:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 05:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 05:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 05:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 05:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 05:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 05:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 05:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 05:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 05:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 05:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 05:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 05:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 05:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 05:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 05:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 05:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 05:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 05:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 05:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 05:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 05:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 05:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 05:42:01 [DEBUG   ] spawn_process: at 2013-08-13 05:42:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 05:42:01 [INFO    ] Finished spawning TBW
2013-08-13 05:42:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:42:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769020584000000
2013-08-13 05:42:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:42:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:42:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:42:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:42:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769020584000000
2013-08-13 05:42:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:42:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769020780000000
2013-08-13 05:42:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:42:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:42:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:42:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:42:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769020780000000
2013-08-13 05:42:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 05:42:03 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:42:03 [DEBUG   ] Finished updating board flags in 1.123 seconds
2013-08-13 05:43:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:43:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769032344000000
2013-08-13 05:43:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:43:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:43:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:43:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:43:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769032344000000
2013-08-13 05:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:43:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769032540000000
2013-08-13 05:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:43:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769032540000000
2013-08-13 05:43:04 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:43:04 [DEBUG   ] Finished updating board flags in 1.676 seconds
2013-08-13 05:44:01 [DEBUG   ] Got command RPT from MCS: ref #18676
2013-08-13 05:44:01 [DEBUG   ] summary = ERROR
2013-08-13 05:44:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18676  13 56517 20641335 A  ERRORERROR'
2013-08-13 05:44:01 [DEBUG   ] Got command RPT from MCS: ref #18677
2013-08-13 05:44:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 05:44:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18677  79 56517 20641335 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 05:44:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:44:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769044104000000
2013-08-13 05:44:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:44:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:44:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:44:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:44:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769044104000000
2013-08-13 05:44:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:44:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769044300000000
2013-08-13 05:44:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:44:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:44:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:44:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:44:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769044300000000
2013-08-13 05:44:03 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:44:03 [DEBUG   ] Finished updating board flags in 0.934 seconds
2013-08-13 05:45:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:45:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769055864000000
2013-08-13 05:45:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:45:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:45:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:45:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:45:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769055864000000
2013-08-13 05:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:45:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769056060000000
2013-08-13 05:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:45:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769056060000000
2013-08-13 05:45:04 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:45:04 [DEBUG   ] Finished updating board flags in 1.468 seconds
2013-08-13 05:45:39 [INFO    ] __waitForTBW - TBW finished in 218.457 s
2013-08-13 05:45:40 [INFO    ] Started antennas statistics background thread
2013-08-13 05:45:40 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 05:45:40 [DEBUG   ] spawn_process: at 2013-08-13 05:45:40 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376372742']
2013-08-13 05:45:40 [DEBUG   ] spawn_process: at 2013-08-13 05:45:40 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376372742']
2013-08-13 05:45:40 [DEBUG   ] spawn_process: at 2013-08-13 05:45:40 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376372742']
2013-08-13 05:45:40 [DEBUG   ] spawn_process: at 2013-08-13 05:45:40 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376372742']
2013-08-13 05:45:40 [DEBUG   ] spawn_process: at 2013-08-13 05:45:40 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376372742']
2013-08-13 05:45:40 [DEBUG   ] spawn_process: at 2013-08-13 05:45:40 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376372742']
2013-08-13 05:45:40 [DEBUG   ] spawn_process: at 2013-08-13 05:45:40 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376372742']
2013-08-13 05:45:40 [DEBUG   ] spawn_process: at 2013-08-13 05:45:40 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376372742']
2013-08-13 05:45:40 [DEBUG   ] spawn_process: at 2013-08-13 05:45:40 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376372742']
2013-08-13 05:45:40 [DEBUG   ] spawn_process: at 2013-08-13 05:45:40 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376372742']
2013-08-13 05:45:40 [DEBUG   ] spawn_process: at 2013-08-13 05:45:40 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376372742']
2013-08-13 05:45:40 [DEBUG   ] spawn_process: at 2013-08-13 05:45:40 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376372742']
2013-08-13 05:45:40 [DEBUG   ] spawn_process: at 2013-08-13 05:45:40 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376372742']
2013-08-13 05:45:40 [DEBUG   ] spawn_process: at 2013-08-13 05:45:40 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376372742']
2013-08-13 05:45:40 [DEBUG   ] spawn_process: at 2013-08-13 05:45:40 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376372742']
2013-08-13 05:45:40 [DEBUG   ] spawn_process: at 2013-08-13 05:45:40 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376372742']
2013-08-13 05:45:40 [DEBUG   ] spawn_process: at 2013-08-13 05:45:40 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376372742']
2013-08-13 05:45:40 [DEBUG   ] spawn_process: at 2013-08-13 05:45:40 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376372742']
2013-08-13 05:45:40 [DEBUG   ] spawn_process: at 2013-08-13 05:45:40 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376372742']
2013-08-13 05:45:40 [DEBUG   ] spawn_process: at 2013-08-13 05:45:40 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376372742']
2013-08-13 05:45:40 [DEBUG   ] spawn_process: at 2013-08-13 05:45:40 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376372742']
2013-08-13 05:45:40 [DEBUG   ] spawn_process: at 2013-08-13 05:45:40 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376372742']
2013-08-13 05:45:41 [DEBUG   ] spawn_process: at 2013-08-13 05:45:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376372742']
2013-08-13 05:45:41 [DEBUG   ] spawn_process: at 2013-08-13 05:45:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376372742']
2013-08-13 05:45:41 [DEBUG   ] spawn_process: at 2013-08-13 05:45:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376372742']
2013-08-13 05:45:41 [DEBUG   ] spawn_process: at 2013-08-13 05:45:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376372742']
2013-08-13 05:45:41 [INFO    ] Finished spawning TBN in 0.050 s
2013-08-13 05:45:41 [DEBUG   ] Finished updating ant stats in 1.293 seconds
2013-08-13 05:46:01 [DEBUG   ] Finished updating ant stats in 1.271 seconds
2013-08-13 05:46:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:46:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769067820000000
2013-08-13 05:46:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:46:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:46:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:46:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:46:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769067820000000
2013-08-13 05:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:46:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769067820000000
2013-08-13 05:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:46:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769067820000000
2013-08-13 05:46:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-08-13 05:46:04 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:46:04 [DEBUG   ] Finished updating board flags in 1.614 seconds
2013-08-13 05:46:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-13 05:46:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 05:47:01 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 05:47:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:47:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769079580000000
2013-08-13 05:47:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:47:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:47:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:47:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:47:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769079580000000
2013-08-13 05:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:47:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769079580000000
2013-08-13 05:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:47:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769079580000000
2013-08-13 05:47:04 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:47:04 [DEBUG   ] Finished updating board flags in 1.621 seconds
2013-08-13 05:47:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 05:47:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 05:47:58 [DEBUG   ] Got command TBW from MCS: ref #18694
2013-08-13 05:47:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 05:47:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18694   8 56517 20878011 A  ERROR'
2013-08-13 05:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 05:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 05:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 05:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 05:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 05:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 05:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 05:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 05:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 05:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 05:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 05:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 05:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 05:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 05:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 05:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 05:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 05:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 05:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 05:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 05:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 05:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 05:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 05:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 05:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 05:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 05:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 05:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 05:48:01 [DEBUG   ] spawn_process: at 2013-08-13 05:48:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 05:48:01 [INFO    ] Finished spawning TBW
2013-08-13 05:48:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:48:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769091340000000
2013-08-13 05:48:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:48:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:48:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:48:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:48:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769091340000000
2013-08-13 05:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:48:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769091340000000
2013-08-13 05:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:48:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769091340000000
2013-08-13 05:48:04 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:48:04 [DEBUG   ] Finished updating board flags in 1.244 seconds
2013-08-13 05:49:01 [DEBUG   ] Got command RPT from MCS: ref #18696
2013-08-13 05:49:01 [DEBUG   ] summary = ERROR
2013-08-13 05:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18696  13 56517 20941343 A  ERRORERROR'
2013-08-13 05:49:01 [DEBUG   ] Got command RPT from MCS: ref #18697
2013-08-13 05:49:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 05:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18697  79 56517 20941343 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 05:49:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:49:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769103100000000
2013-08-13 05:49:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:49:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:49:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:49:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:49:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769103100000000
2013-08-13 05:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:49:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769103100000000
2013-08-13 05:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:49:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769103100000000
2013-08-13 05:49:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 05:49:04 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:49:04 [DEBUG   ] Finished updating board flags in 1.337 seconds
2013-08-13 05:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:50:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769114860000000
2013-08-13 05:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:50:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769114860000000
2013-08-13 05:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:50:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769114860000000
2013-08-13 05:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:50:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769114860000000
2013-08-13 05:50:04 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:50:04 [DEBUG   ] Finished updating board flags in 1.072 seconds
2013-08-13 05:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:51:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769126620000000
2013-08-13 05:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:51:03 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769126620000000
2013-08-13 05:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:51:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769126620000000
2013-08-13 05:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:51:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769126620000000
2013-08-13 05:51:04 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:51:04 [DEBUG   ] Finished updating board flags in 1.198 seconds
2013-08-13 05:51:40 [INFO    ] __waitForTBW - TBW finished in 218.591 s
2013-08-13 05:51:41 [INFO    ] Started antennas statistics background thread
2013-08-13 05:51:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376373102']
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376373102']
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376373102']
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376373102']
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376373102']
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376373102']
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376373102']
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376373102']
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376373102']
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376373102']
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376373102']
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376373102']
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376373102']
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376373102']
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376373102']
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376373102']
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376373102']
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376373102']
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376373102']
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376373102']
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376373102']
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376373102']
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376373102']
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376373102']
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376373102']
2013-08-13 05:51:41 [DEBUG   ] spawn_process: at 2013-08-13 05:51:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376373102']
2013-08-13 05:51:41 [INFO    ] Finished spawning TBN in 0.050 s
2013-08-13 05:51:41 [DEBUG   ] Finished updating ant stats in 1.252 seconds
2013-08-13 05:52:01 [DEBUG   ] Finished updating ant stats in 1.187 seconds
2013-08-13 05:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:52:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769138380000000
2013-08-13 05:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:52:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769138380000000
2013-08-13 05:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:52:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769138576000000
2013-08-13 05:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:52:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769138576000000
2013-08-13 05:52:05 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:52:05 [DEBUG   ] Finished updating board flags in 2.150 seconds
2013-08-13 05:52:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 05:52:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 05:53:01 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 05:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:53:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769150140000000
2013-08-13 05:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:53:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769150140000000
2013-08-13 05:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:53:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769150336000000
2013-08-13 05:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:53:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769150336000000
2013-08-13 05:53:05 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:53:05 [DEBUG   ] Finished updating board flags in 1.868 seconds
2013-08-13 05:53:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 05:53:41 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-13 05:53:58 [DEBUG   ] Got command TBW from MCS: ref #18714
2013-08-13 05:53:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 05:53:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18714   8 56517 21238015 A  ERROR'
2013-08-13 05:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 05:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 05:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 05:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 05:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 05:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 05:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 05:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 05:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 05:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 05:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 05:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 05:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 05:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 05:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 05:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 05:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 05:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 05:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 05:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 05:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 05:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 05:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 05:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 05:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 05:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 05:54:01 [DEBUG   ] Got command RPT from MCS: ref #18716
2013-08-13 05:54:01 [DEBUG   ] summary = ERROR
2013-08-13 05:54:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18716  13 56517 21241343 A  ERRORERROR'
2013-08-13 05:54:01 [DEBUG   ] Got command RPT from MCS: ref #18717
2013-08-13 05:54:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 05:54:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18717  79 56517 21241343 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 05:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 05:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 05:54:01 [DEBUG   ] spawn_process: at 2013-08-13 05:54:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 05:54:01 [INFO    ] Finished spawning TBW
2013-08-13 05:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:54:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769161900000000
2013-08-13 05:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:54:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769161900000000
2013-08-13 05:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:54:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769162096000000
2013-08-13 05:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:54:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769162096000000
2013-08-13 05:54:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-08-13 05:54:05 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:54:05 [DEBUG   ] Finished updating board flags in 1.615 seconds
2013-08-13 05:55:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:55:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769173660000000
2013-08-13 05:55:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:55:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:55:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:55:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:55:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769173660000000
2013-08-13 05:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:55:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769173856000000
2013-08-13 05:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:55:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769173856000000
2013-08-13 05:55:05 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:55:05 [DEBUG   ] Finished updating board flags in 1.711 seconds
2013-08-13 05:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:56:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769185420000000
2013-08-13 05:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:56:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769185420000000
2013-08-13 05:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:56:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769185616000000
2013-08-13 05:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:56:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769185616000000
2013-08-13 05:56:04 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:56:04 [DEBUG   ] Finished updating board flags in 0.938 seconds
2013-08-13 05:57:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:57:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769197180000000
2013-08-13 05:57:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:57:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:57:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:57:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:57:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769197180000000
2013-08-13 05:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:57:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769197376000000
2013-08-13 05:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:57:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769197376000000
2013-08-13 05:57:05 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:57:05 [DEBUG   ] Finished updating board flags in 1.470 seconds
2013-08-13 05:57:40 [INFO    ] __waitForTBW - TBW finished in 218.744 s
2013-08-13 05:57:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 05:57:41 [INFO    ] Started antennas statistics background thread
2013-08-13 05:57:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376373462']
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376373462']
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376373462']
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376373462']
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376373462']
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376373462']
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376373462']
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376373462']
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376373462']
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376373462']
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376373462']
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376373462']
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376373462']
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376373462']
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376373462']
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376373462']
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376373462']
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376373462']
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376373462']
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376373462']
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376373462']
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376373462']
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376373462']
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376373462']
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376373462']
2013-08-13 05:57:41 [DEBUG   ] spawn_process: at 2013-08-13 05:57:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376373462']
2013-08-13 05:57:41 [INFO    ] Finished spawning TBN in 0.050 s
2013-08-13 05:58:01 [DEBUG   ] Finished updating ant stats in 1.071 seconds
2013-08-13 05:58:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:58:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769209136000000
2013-08-13 05:58:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:58:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:58:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:58:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:58:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769209136000000
2013-08-13 05:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:58:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769209136000000
2013-08-13 05:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:58:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769209136000000
2013-08-13 05:58:05 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:58:05 [DEBUG   ] Finished updating board flags in 1.623 seconds
2013-08-13 05:58:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 05:58:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 05:59:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 05:59:01 [DEBUG   ] Got command RPT from MCS: ref #18733
2013-08-13 05:59:01 [DEBUG   ] summary = ERROR
2013-08-13 05:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18733  13 56517 21541343 A  ERRORERROR'
2013-08-13 05:59:01 [DEBUG   ] Got command RPT from MCS: ref #18734
2013-08-13 05:59:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 05:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18734  79 56517 21541343 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 05:59:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 05:59:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769220896000000
2013-08-13 05:59:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 05:59:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 05:59:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 05:59:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 05:59:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769220896000000
2013-08-13 05:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 05:59:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769220896000000
2013-08-13 05:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 05:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 05:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 05:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 05:59:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769220896000000
2013-08-13 05:59:05 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 05:59:05 [DEBUG   ] Finished updating board flags in 1.632 seconds
2013-08-13 05:59:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 05:59:41 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-13 05:59:58 [DEBUG   ] Got command TBW from MCS: ref #18751
2013-08-13 05:59:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 05:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18751   8 56517 21598015 A  ERROR'
2013-08-13 05:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 05:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 05:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 05:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 05:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 06:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 06:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 06:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 06:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 06:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 06:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 06:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 06:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 06:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 06:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 06:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 06:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 06:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 06:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 06:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 06:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 06:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 06:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 06:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 06:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 06:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 06:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 06:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 06:00:01 [DEBUG   ] spawn_process: at 2013-08-13 06:00:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 06:00:01 [INFO    ] Finished spawning TBW
2013-08-13 06:00:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:00:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769232656000000
2013-08-13 06:00:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:00:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:00:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:00:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:00:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769232656000000
2013-08-13 06:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:00:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769232656000000
2013-08-13 06:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:00:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769232656000000
2013-08-13 06:00:05 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:00:05 [DEBUG   ] Finished updating board flags in 1.222 seconds
2013-08-13 06:01:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:01:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769244416000000
2013-08-13 06:01:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:01:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:01:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:01:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:01:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769244416000000
2013-08-13 06:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:01:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769244416000000
2013-08-13 06:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:01:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769244416000000
2013-08-13 06:01:05 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:01:05 [DEBUG   ] Finished updating board flags in 1.325 seconds
2013-08-13 06:02:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:02:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769256176000000
2013-08-13 06:02:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:02:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:02:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:02:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:02:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769256176000000
2013-08-13 06:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:02:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769256176000000
2013-08-13 06:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:02:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769256176000000
2013-08-13 06:02:05 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:02:05 [DEBUG   ] Finished updating board flags in 1.076 seconds
2013-08-13 06:03:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:03:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769267936000000
2013-08-13 06:03:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:03:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:03:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:03:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:03:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769267936000000
2013-08-13 06:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-08-13 06:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:03:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769267936000000
2013-08-13 06:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:03:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769267936000000
2013-08-13 06:03:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-08-13 06:03:05 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:03:05 [DEBUG   ] Finished updating board flags in 1.200 seconds
2013-08-13 06:03:40 [INFO    ] __waitForTBW - TBW finished in 218.679 s
2013-08-13 06:03:41 [INFO    ] Started antennas statistics background thread
2013-08-13 06:03:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376373822']
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376373822']
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376373822']
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376373822']
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376373822']
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376373822']
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376373822']
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376373822']
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376373822']
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376373822']
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376373822']
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376373822']
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376373822']
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376373822']
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376373822']
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376373822']
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376373822']
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376373822']
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376373822']
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376373822']
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376373822']
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376373822']
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376373822']
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376373822']
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376373822']
2013-08-13 06:03:41 [DEBUG   ] spawn_process: at 2013-08-13 06:03:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376373822']
2013-08-13 06:03:41 [INFO    ] Finished spawning TBN in 0.052 s
2013-08-13 06:03:41 [DEBUG   ] Finished updating ant stats in 1.160 seconds
2013-08-13 06:04:01 [DEBUG   ] Finished updating ant stats in 0.986 seconds
2013-08-13 06:04:01 [DEBUG   ] Got command RPT from MCS: ref #18753
2013-08-13 06:04:01 [DEBUG   ] summary = ERROR
2013-08-13 06:04:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18753  13 56517 21841347 A  ERRORERROR'
2013-08-13 06:04:01 [DEBUG   ] Got command RPT from MCS: ref #18754
2013-08-13 06:04:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 06:04:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18754  79 56517 21841347 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 06:04:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:04:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769279696000000
2013-08-13 06:04:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:04:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:04:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:04:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:04:04 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769279696000000
2013-08-13 06:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:04:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769279892000000
2013-08-13 06:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:04:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769279892000000
2013-08-13 06:04:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 06:04:06 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:04:06 [DEBUG   ] Finished updating board flags in 1.616 seconds
2013-08-13 06:04:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 06:04:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 06:05:01 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 06:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:05:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769291456000000
2013-08-13 06:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:05:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769291456000000
2013-08-13 06:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:05:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769291652000000
2013-08-13 06:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:05:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769291652000000
2013-08-13 06:05:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 06:05:06 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:05:06 [DEBUG   ] Finished updating board flags in 2.339 seconds
2013-08-13 06:05:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 06:05:41 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-13 06:05:58 [DEBUG   ] Got command TBW from MCS: ref #18771
2013-08-13 06:05:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 06:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18771   8 56517 21958011 A  ERROR'
2013-08-13 06:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 06:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 06:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 06:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 06:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 06:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 06:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 06:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 06:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 06:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 06:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 06:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 06:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 06:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 06:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 06:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 06:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 06:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 06:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 06:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 06:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 06:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 06:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 06:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 06:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 06:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 06:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 06:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 06:06:01 [DEBUG   ] spawn_process: at 2013-08-13 06:06:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 06:06:01 [INFO    ] Finished spawning TBW
2013-08-13 06:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:06:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769303216000000
2013-08-13 06:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:06:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769303216000000
2013-08-13 06:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:06:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769303412000000
2013-08-13 06:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:06:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769303412000000
2013-08-13 06:06:05 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:06:05 [DEBUG   ] Finished updating board flags in 1.319 seconds
2013-08-13 06:07:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:07:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769314976000000
2013-08-13 06:07:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:07:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:07:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:07:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:07:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769314976000000
2013-08-13 06:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:07:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769315172000000
2013-08-13 06:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:07:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769315172000000
2013-08-13 06:07:06 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:07:06 [DEBUG   ] Finished updating board flags in 1.874 seconds
2013-08-13 06:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:08:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769326736000000
2013-08-13 06:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:08:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769326736000000
2013-08-13 06:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:08:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769326932000000
2013-08-13 06:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:08:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769326932000000
2013-08-13 06:08:05 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:08:05 [DEBUG   ] Finished updating board flags in 1.143 seconds
2013-08-13 06:09:01 [DEBUG   ] Got command RPT from MCS: ref #18773
2013-08-13 06:09:01 [DEBUG   ] summary = ERROR
2013-08-13 06:09:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18773  13 56517 22141351 A  ERRORERROR'
2013-08-13 06:09:01 [DEBUG   ] Got command RPT from MCS: ref #18774
2013-08-13 06:09:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 06:09:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18774  79 56517 22141352 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 06:09:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:09:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769338496000000
2013-08-13 06:09:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:09:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:09:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:09:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:09:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769338496000000
2013-08-13 06:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:09:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769338692000000
2013-08-13 06:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:09:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769338692000000
2013-08-13 06:09:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 06:09:06 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:09:06 [DEBUG   ] Finished updating board flags in 1.656 seconds
2013-08-13 06:09:40 [INFO    ] __waitForTBW - TBW finished in 218.558 s
2013-08-13 06:09:41 [INFO    ] Started antennas statistics background thread
2013-08-13 06:09:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376374182']
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376374182']
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376374182']
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376374182']
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376374182']
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376374182']
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376374182']
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376374182']
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376374182']
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376374182']
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376374182']
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376374182']
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376374182']
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376374182']
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376374182']
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376374182']
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376374182']
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376374182']
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376374182']
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376374182']
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376374182']
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376374182']
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376374182']
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376374182']
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376374182']
2013-08-13 06:09:41 [DEBUG   ] spawn_process: at 2013-08-13 06:09:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376374182']
2013-08-13 06:09:41 [INFO    ] Finished spawning TBN in 0.052 s
2013-08-13 06:09:41 [DEBUG   ] Finished updating ant stats in 1.267 seconds
2013-08-13 06:10:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-13 06:10:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:10:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769350256000000
2013-08-13 06:10:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:10:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:10:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:10:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:10:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769350256000000
2013-08-13 06:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:10:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769350452000000
2013-08-13 06:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:10:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769350452000000
2013-08-13 06:10:06 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:10:06 [DEBUG   ] Finished updating board flags in 1.821 seconds
2013-08-13 06:10:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 06:10:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 06:11:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-13 06:11:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:11:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769362016000000
2013-08-13 06:11:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:11:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:11:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:11:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:11:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769362016000000
2013-08-13 06:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:11:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769362212000000
2013-08-13 06:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:11:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769362212000000
2013-08-13 06:11:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 06:11:06 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:11:06 [DEBUG   ] Finished updating board flags in 1.647 seconds
2013-08-13 06:11:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 06:11:41 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-13 06:11:58 [DEBUG   ] Got command TBW from MCS: ref #18791
2013-08-13 06:11:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 06:11:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18791   8 56517 22318015 A  ERROR'
2013-08-13 06:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 06:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 06:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 06:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 06:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 06:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 06:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 06:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 06:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 06:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 06:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 06:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 06:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 06:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 06:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 06:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 06:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 06:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 06:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 06:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 06:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 06:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 06:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 06:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 06:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 06:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 06:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 06:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 06:12:01 [DEBUG   ] spawn_process: at 2013-08-13 06:12:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 06:12:01 [INFO    ] Finished spawning TBW
2013-08-13 06:12:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:12:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769373776000000
2013-08-13 06:12:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:12:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:12:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:12:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:12:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769373776000000
2013-08-13 06:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:12:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769373972000000
2013-08-13 06:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:12:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769373972000000
2013-08-13 06:12:06 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:12:06 [DEBUG   ] Finished updating board flags in 1.418 seconds
2013-08-13 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:13:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769385536000000
2013-08-13 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:13:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769385536000000
2013-08-13 06:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:13:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769385732000000
2013-08-13 06:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:13:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769385732000000
2013-08-13 06:13:06 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:13:06 [DEBUG   ] Finished updating board flags in 1.518 seconds
2013-08-13 06:14:01 [DEBUG   ] Got command RPT from MCS: ref #18793
2013-08-13 06:14:01 [DEBUG   ] summary = ERROR
2013-08-13 06:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18793  13 56517 22441347 A  ERRORERROR'
2013-08-13 06:14:01 [DEBUG   ] Got command RPT from MCS: ref #18794
2013-08-13 06:14:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 06:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18794  79 56517 22441347 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:14:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769397492000000
2013-08-13 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:14:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769397492000000
2013-08-13 06:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:14:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769397492000000
2013-08-13 06:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:14:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769397492000000
2013-08-13 06:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 06:14:06 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:14:06 [DEBUG   ] Finished updating board flags in 1.287 seconds
2013-08-13 06:15:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:15:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769409252000000
2013-08-13 06:15:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:15:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:15:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:15:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:15:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769409252000000
2013-08-13 06:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:15:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769409252000000
2013-08-13 06:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:15:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769409252000000
2013-08-13 06:15:06 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:15:06 [DEBUG   ] Finished updating board flags in 1.308 seconds
2013-08-13 06:15:39 [INFO    ] __waitForTBW - TBW finished in 218.481 s
2013-08-13 06:15:40 [INFO    ] Started antennas statistics background thread
2013-08-13 06:15:40 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 06:15:40 [DEBUG   ] spawn_process: at 2013-08-13 06:15:40 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376374542']
2013-08-13 06:15:40 [DEBUG   ] spawn_process: at 2013-08-13 06:15:40 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376374542']
2013-08-13 06:15:40 [DEBUG   ] spawn_process: at 2013-08-13 06:15:40 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376374542']
2013-08-13 06:15:40 [DEBUG   ] spawn_process: at 2013-08-13 06:15:40 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376374542']
2013-08-13 06:15:40 [DEBUG   ] spawn_process: at 2013-08-13 06:15:40 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376374542']
2013-08-13 06:15:40 [DEBUG   ] spawn_process: at 2013-08-13 06:15:40 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376374542']
2013-08-13 06:15:40 [DEBUG   ] spawn_process: at 2013-08-13 06:15:40 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376374542']
2013-08-13 06:15:40 [DEBUG   ] spawn_process: at 2013-08-13 06:15:40 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376374542']
2013-08-13 06:15:40 [DEBUG   ] spawn_process: at 2013-08-13 06:15:40 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376374542']
2013-08-13 06:15:40 [DEBUG   ] spawn_process: at 2013-08-13 06:15:40 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376374542']
2013-08-13 06:15:40 [DEBUG   ] spawn_process: at 2013-08-13 06:15:40 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376374542']
2013-08-13 06:15:41 [DEBUG   ] spawn_process: at 2013-08-13 06:15:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376374542']
2013-08-13 06:15:41 [DEBUG   ] spawn_process: at 2013-08-13 06:15:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376374542']
2013-08-13 06:15:41 [DEBUG   ] spawn_process: at 2013-08-13 06:15:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376374542']
2013-08-13 06:15:41 [DEBUG   ] spawn_process: at 2013-08-13 06:15:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376374542']
2013-08-13 06:15:41 [DEBUG   ] spawn_process: at 2013-08-13 06:15:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376374542']
2013-08-13 06:15:41 [DEBUG   ] spawn_process: at 2013-08-13 06:15:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376374542']
2013-08-13 06:15:41 [DEBUG   ] spawn_process: at 2013-08-13 06:15:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376374542']
2013-08-13 06:15:41 [DEBUG   ] spawn_process: at 2013-08-13 06:15:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376374542']
2013-08-13 06:15:41 [DEBUG   ] spawn_process: at 2013-08-13 06:15:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376374542']
2013-08-13 06:15:41 [DEBUG   ] spawn_process: at 2013-08-13 06:15:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376374542']
2013-08-13 06:15:41 [DEBUG   ] spawn_process: at 2013-08-13 06:15:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376374542']
2013-08-13 06:15:41 [DEBUG   ] spawn_process: at 2013-08-13 06:15:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376374542']
2013-08-13 06:15:41 [DEBUG   ] spawn_process: at 2013-08-13 06:15:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376374542']
2013-08-13 06:15:41 [DEBUG   ] spawn_process: at 2013-08-13 06:15:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376374542']
2013-08-13 06:15:41 [DEBUG   ] spawn_process: at 2013-08-13 06:15:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376374542']
2013-08-13 06:15:41 [INFO    ] Finished spawning TBN in 0.050 s
2013-08-13 06:15:41 [DEBUG   ] Finished updating ant stats in 1.275 seconds
2013-08-13 06:16:01 [DEBUG   ] Finished updating ant stats in 1.268 seconds
2013-08-13 06:16:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:16:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769421012000000
2013-08-13 06:16:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:16:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:16:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:16:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:16:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769421012000000
2013-08-13 06:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:16:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769421208000000
2013-08-13 06:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:16:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769421208000000
2013-08-13 06:16:06 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:16:06 [DEBUG   ] Finished updating board flags in 1.616 seconds
2013-08-13 06:16:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 06:16:41 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 06:17:01 [DEBUG   ] Finished updating ant stats in 1.073 seconds
2013-08-13 06:17:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:17:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769432772000000
2013-08-13 06:17:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:17:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:17:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:17:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:17:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769432772000000
2013-08-13 06:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:17:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769432968000000
2013-08-13 06:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:17:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769432968000000
2013-08-13 06:17:06 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:17:06 [DEBUG   ] Finished updating board flags in 1.617 seconds
2013-08-13 06:17:21 [DEBUG   ] Finished updating ant stats in 0.931 seconds
2013-08-13 06:17:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 06:17:58 [DEBUG   ] Got command TBW from MCS: ref #18811
2013-08-13 06:17:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 06:17:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18811   8 56517 22678007 A  ERROR'
2013-08-13 06:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 06:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 06:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 06:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 06:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 06:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 06:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 06:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 06:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 06:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 06:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 06:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 06:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 06:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 06:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 06:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 06:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 06:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 06:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 06:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 06:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 06:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 06:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 06:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 06:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 06:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 06:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 06:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 06:18:01 [DEBUG   ] spawn_process: at 2013-08-13 06:18:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 06:18:01 [INFO    ] Finished spawning TBW
2013-08-13 06:18:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:18:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769444532000000
2013-08-13 06:18:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:18:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:18:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:18:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:18:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769444532000000
2013-08-13 06:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:18:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769444532000000
2013-08-13 06:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:18:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769444532000000
2013-08-13 06:18:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 06:18:06 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:18:06 [DEBUG   ] Finished updating board flags in 1.053 seconds
2013-08-13 06:19:01 [DEBUG   ] Got command RPT from MCS: ref #18813
2013-08-13 06:19:01 [DEBUG   ] summary = ERROR
2013-08-13 06:19:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18813  13 56517 22741343 A  ERRORERROR'
2013-08-13 06:19:01 [DEBUG   ] Got command RPT from MCS: ref #18814
2013-08-13 06:19:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 06:19:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18814  79 56517 22741343 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 06:19:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:19:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769456292000000
2013-08-13 06:19:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:19:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:19:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:19:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:19:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769456292000000
2013-08-13 06:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:19:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769456292000000
2013-08-13 06:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:19:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769456292000000
2013-08-13 06:19:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 06:19:06 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:19:06 [DEBUG   ] Finished updating board flags in 1.204 seconds
2013-08-13 06:20:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:20:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769468052000000
2013-08-13 06:20:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:20:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:20:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:20:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:20:05 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769468052000000
2013-08-13 06:20:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:20:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769468052000000
2013-08-13 06:20:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:20:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:20:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:20:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:20:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769468052000000
2013-08-13 06:20:06 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:20:06 [DEBUG   ] Finished updating board flags in 1.005 seconds
2013-08-13 06:21:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:21:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769479812000000
2013-08-13 06:21:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:21:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:21:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:21:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:21:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769479812000000
2013-08-13 06:21:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:21:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769480008000000
2013-08-13 06:21:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:21:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:21:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:21:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:21:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769480008000000
2013-08-13 06:21:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 06:21:07 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:21:07 [DEBUG   ] Finished updating board flags in 2.126 seconds
2013-08-13 06:21:40 [INFO    ] __waitForTBW - TBW finished in 218.763 s
2013-08-13 06:21:41 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2013-08-13 06:21:41 [INFO    ] Started antennas statistics background thread
2013-08-13 06:21:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376374902']
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376374902']
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376374902']
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376374902']
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376374902']
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376374902']
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376374902']
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376374902']
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376374902']
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376374902']
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376374902']
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376374902']
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376374902']
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376374902']
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376374902']
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376374902']
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376374902']
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376374902']
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376374902']
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376374902']
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376374902']
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376374902']
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376374902']
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376374902']
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376374902']
2013-08-13 06:21:41 [DEBUG   ] spawn_process: at 2013-08-13 06:21:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376374902']
2013-08-13 06:21:41 [INFO    ] Finished spawning TBN in 0.050 s
2013-08-13 06:22:01 [DEBUG   ] Finished updating ant stats in 0.872 seconds
2013-08-13 06:22:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:22:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769491572000000
2013-08-13 06:22:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:22:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:22:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:22:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:22:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769491572000000
2013-08-13 06:22:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:22:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769491768000000
2013-08-13 06:22:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:22:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:22:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:22:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:22:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769491768000000
2013-08-13 06:22:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 06:22:07 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:22:07 [DEBUG   ] Finished updating board flags in 2.216 seconds
2013-08-13 06:22:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 06:22:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 06:23:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:23:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769503332000000
2013-08-13 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:23:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769503332000000
2013-08-13 06:23:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:23:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769503528000000
2013-08-13 06:23:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:23:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:23:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:23:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:23:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769503528000000
2013-08-13 06:23:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 06:23:07 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:23:07 [DEBUG   ] Finished updating board flags in 2.051 seconds
2013-08-13 06:23:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 06:23:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 06:23:58 [DEBUG   ] Got command TBW from MCS: ref #18831
2013-08-13 06:23:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 06:23:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18831   8 56517 23038011 A  ERROR'
2013-08-13 06:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 06:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 06:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 06:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 06:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 06:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 06:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 06:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 06:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 06:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 06:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 06:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 06:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 06:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 06:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 06:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 06:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 06:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 06:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 06:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 06:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 06:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 06:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 06:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 06:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 06:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 06:24:01 [DEBUG   ] Got command RPT from MCS: ref #18833
2013-08-13 06:24:01 [DEBUG   ] summary = ERROR
2013-08-13 06:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18833  13 56517 23041351 A  ERRORERROR'
2013-08-13 06:24:01 [DEBUG   ] Got command RPT from MCS: ref #18834
2013-08-13 06:24:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 06:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18834  79 56517 23041352 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 06:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 06:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 06:24:01 [DEBUG   ] spawn_process: at 2013-08-13 06:24:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 06:24:01 [INFO    ] Finished spawning TBW
2013-08-13 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:24:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769515092000000
2013-08-13 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:24:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769515092000000
2013-08-13 06:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:24:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769515288000000
2013-08-13 06:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:24:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769515288000000
2013-08-13 06:24:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 06:24:07 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:24:07 [DEBUG   ] Finished updating board flags in 1.829 seconds
2013-08-13 06:25:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:25:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769526852000000
2013-08-13 06:25:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:25:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:25:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:25:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:25:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769526852000000
2013-08-13 06:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:25:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769527048000000
2013-08-13 06:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:25:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769527048000000
2013-08-13 06:25:07 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:25:07 [DEBUG   ] Finished updating board flags in 1.917 seconds
2013-08-13 06:26:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:26:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769538612000000
2013-08-13 06:26:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:26:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:26:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:26:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:26:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769538612000000
2013-08-13 06:26:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-08-13 06:26:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:26:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769538808000000
2013-08-13 06:26:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:26:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:26:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:26:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:26:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769538808000000
2013-08-13 06:26:06 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:26:06 [DEBUG   ] Finished updating board flags in 1.130 seconds
2013-08-13 06:27:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:27:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769550372000000
2013-08-13 06:27:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:27:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:27:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:27:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:27:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769550372000000
2013-08-13 06:27:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:27:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769550568000000
2013-08-13 06:27:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:27:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:27:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:27:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:27:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769550568000000
2013-08-13 06:27:07 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:27:07 [DEBUG   ] Finished updating board flags in 1.662 seconds
2013-08-13 06:27:39 [INFO    ] __waitForTBW - TBW finished in 218.438 s
2013-08-13 06:27:40 [INFO    ] Started antennas statistics background thread
2013-08-13 06:27:40 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376375262']
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376375262']
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376375262']
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376375262']
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376375262']
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376375262']
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376375262']
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376375262']
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376375262']
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376375262']
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376375262']
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376375262']
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376375262']
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376375262']
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376375262']
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376375262']
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376375262']
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376375262']
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376375262']
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376375262']
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376375262']
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376375262']
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376375262']
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376375262']
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376375262']
2013-08-13 06:27:40 [DEBUG   ] spawn_process: at 2013-08-13 06:27:40 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376375262']
2013-08-13 06:27:40 [INFO    ] Finished spawning TBN in 0.049 s
2013-08-13 06:27:41 [DEBUG   ] Finished updating ant stats in 1.307 seconds
2013-08-13 06:28:01 [DEBUG   ] Finished updating ant stats in 1.273 seconds
2013-08-13 06:28:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:28:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769562132000000
2013-08-13 06:28:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:28:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:28:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:28:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:28:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769562132000000
2013-08-13 06:28:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-08-13 06:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:28:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769562328000000
2013-08-13 06:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:28:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769562328000000
2013-08-13 06:28:07 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:28:07 [DEBUG   ] Finished updating board flags in 1.826 seconds
2013-08-13 06:28:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 06:28:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 06:29:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 06:29:01 [DEBUG   ] Got command RPT from MCS: ref #18850
2013-08-13 06:29:01 [DEBUG   ] summary = ERROR
2013-08-13 06:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18850  13 56517 23341355 A  ERRORERROR'
2013-08-13 06:29:01 [DEBUG   ] Got command RPT from MCS: ref #18851
2013-08-13 06:29:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 06:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18851  79 56517 23341355 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 06:29:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:29:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769573892000000
2013-08-13 06:29:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:29:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:29:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:29:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:29:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769573892000000
2013-08-13 06:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:29:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769574088000000
2013-08-13 06:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:29:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769574088000000
2013-08-13 06:29:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 06:29:07 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:29:07 [DEBUG   ] Finished updating board flags in 1.644 seconds
2013-08-13 06:29:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 06:29:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-13 06:29:58 [DEBUG   ] Got command TBW from MCS: ref #18868
2013-08-13 06:29:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 06:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18868   8 56517 23398011 A  ERROR'
2013-08-13 06:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 06:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 06:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 06:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 06:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 06:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 06:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 06:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 06:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 06:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 06:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 06:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 06:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 06:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 06:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 06:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 06:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 06:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 06:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 06:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 06:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 06:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 06:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 06:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 06:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 06:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 06:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 06:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 06:30:01 [DEBUG   ] spawn_process: at 2013-08-13 06:30:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 06:30:01 [INFO    ] Finished spawning TBW
2013-08-13 06:30:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:30:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769585652000000
2013-08-13 06:30:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:30:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:30:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:30:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:30:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769585652000000
2013-08-13 06:30:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:30:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769585848000000
2013-08-13 06:30:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:30:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:30:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:30:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:30:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769585848000000
2013-08-13 06:30:07 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:30:07 [DEBUG   ] Finished updating board flags in 1.535 seconds
2013-08-13 06:31:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:31:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769597608000000
2013-08-13 06:31:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:31:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:31:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:31:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:31:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769597608000000
2013-08-13 06:31:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:31:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769597608000000
2013-08-13 06:31:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:31:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:31:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:31:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:31:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769597608000000
2013-08-13 06:31:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 06:31:07 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:31:07 [DEBUG   ] Finished updating board flags in 1.409 seconds
2013-08-13 06:32:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:32:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769609368000000
2013-08-13 06:32:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:32:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:32:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:32:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:32:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769609368000000
2013-08-13 06:32:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:32:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769609368000000
2013-08-13 06:32:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:32:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:32:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:32:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:32:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769609368000000
2013-08-13 06:32:07 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:32:07 [DEBUG   ] Finished updating board flags in 1.283 seconds
2013-08-13 06:33:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:33:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769621128000000
2013-08-13 06:33:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:33:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:33:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:33:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:33:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769621128000000
2013-08-13 06:33:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:33:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769621128000000
2013-08-13 06:33:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:33:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:33:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:33:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:33:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769621128000000
2013-08-13 06:33:07 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:33:07 [DEBUG   ] Finished updating board flags in 1.329 seconds
2013-08-13 06:33:40 [INFO    ] __waitForTBW - TBW finished in 218.572 s
2013-08-13 06:33:41 [INFO    ] Started antennas statistics background thread
2013-08-13 06:33:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376375622']
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376375622']
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376375622']
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376375622']
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376375622']
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376375622']
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376375622']
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376375622']
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376375622']
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376375622']
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376375622']
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376375622']
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376375622']
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376375622']
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376375622']
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376375622']
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376375622']
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376375622']
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376375622']
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376375622']
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376375622']
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376375622']
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376375622']
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376375622']
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376375622']
2013-08-13 06:33:41 [DEBUG   ] spawn_process: at 2013-08-13 06:33:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376375622']
2013-08-13 06:33:41 [INFO    ] Finished spawning TBN in 0.054 s
2013-08-13 06:33:41 [DEBUG   ] Finished updating ant stats in 1.268 seconds
2013-08-13 06:34:01 [DEBUG   ] Finished updating ant stats in 1.189 seconds
2013-08-13 06:34:01 [DEBUG   ] Got command RPT from MCS: ref #18870
2013-08-13 06:34:01 [DEBUG   ] summary = ERROR
2013-08-13 06:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18870  13 56517 23641351 A  ERRORERROR'
2013-08-13 06:34:01 [DEBUG   ] Got command RPT from MCS: ref #18871
2013-08-13 06:34:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 06:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18871  79 56517 23641351 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 06:34:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:34:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769632888000000
2013-08-13 06:34:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:34:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:34:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:34:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:34:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769632888000000
2013-08-13 06:34:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:34:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769633084000000
2013-08-13 06:34:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:34:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:34:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:34:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:34:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769633084000000
2013-08-13 06:34:08 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:34:08 [DEBUG   ] Finished updating board flags in 1.630 seconds
2013-08-13 06:34:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 06:34:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 06:35:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 06:35:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:35:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769644648000000
2013-08-13 06:35:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:35:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:35:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:35:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:35:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769644648000000
2013-08-13 06:35:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:35:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769644844000000
2013-08-13 06:35:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:35:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:35:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:35:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:35:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769644844000000
2013-08-13 06:35:08 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:35:08 [DEBUG   ] Finished updating board flags in 1.636 seconds
2013-08-13 06:35:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 06:35:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 06:35:58 [DEBUG   ] Got command TBW from MCS: ref #18888
2013-08-13 06:35:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 06:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18888   8 56517 23758007 A  ERROR'
2013-08-13 06:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 06:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 06:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 06:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 06:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 06:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 06:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 06:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 06:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 06:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 06:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 06:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 06:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 06:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 06:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 06:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 06:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 06:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 06:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 06:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 06:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 06:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 06:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 06:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 06:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 06:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 06:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 06:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 06:36:01 [DEBUG   ] spawn_process: at 2013-08-13 06:36:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 06:36:01 [INFO    ] Finished spawning TBW
2013-08-13 06:36:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:36:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769656408000000
2013-08-13 06:36:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:36:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:36:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:36:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:36:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769656408000000
2013-08-13 06:36:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:36:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769656408000000
2013-08-13 06:36:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:36:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:36:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:36:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:36:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769656408000000
2013-08-13 06:36:07 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:36:07 [DEBUG   ] Finished updating board flags in 1.001 seconds
2013-08-13 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:37:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769668168000000
2013-08-13 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:37:06 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769668168000000
2013-08-13 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:37:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769668168000000
2013-08-13 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:37:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769668168000000
2013-08-13 06:37:07 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:37:07 [DEBUG   ] Finished updating board flags in 1.187 seconds
2013-08-13 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:38:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769679928000000
2013-08-13 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:38:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769679928000000
2013-08-13 06:38:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:38:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769680124000000
2013-08-13 06:38:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:38:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:38:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:38:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:38:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769680124000000
2013-08-13 06:38:08 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:38:08 [DEBUG   ] Finished updating board flags in 1.953 seconds
2013-08-13 06:39:01 [DEBUG   ] Got command RPT from MCS: ref #18890
2013-08-13 06:39:01 [DEBUG   ] summary = ERROR
2013-08-13 06:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18890  13 56517 23941355 A  ERRORERROR'
2013-08-13 06:39:01 [DEBUG   ] Got command RPT from MCS: ref #18891
2013-08-13 06:39:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 06:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18891  79 56517 23941355 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 06:39:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:39:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769691688000000
2013-08-13 06:39:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:39:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:39:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:39:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:39:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769691688000000
2013-08-13 06:39:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:39:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769691884000000
2013-08-13 06:39:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:39:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:39:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:39:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:39:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769691884000000
2013-08-13 06:39:07 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:39:07 [DEBUG   ] Finished updating board flags in 1.131 seconds
2013-08-13 06:39:40 [INFO    ] __waitForTBW - TBW finished in 218.671 s
2013-08-13 06:39:41 [INFO    ] Started antennas statistics background thread
2013-08-13 06:39:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376375982']
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376375982']
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376375982']
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376375982']
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376375982']
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376375982']
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376375982']
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376375982']
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376375982']
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376375982']
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376375982']
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376375982']
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376375982']
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376375982']
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376375982']
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376375982']
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376375982']
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376375982']
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376375982']
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376375982']
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376375982']
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376375982']
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376375982']
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376375982']
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376375982']
2013-08-13 06:39:41 [DEBUG   ] spawn_process: at 2013-08-13 06:39:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376375982']
2013-08-13 06:39:41 [INFO    ] Finished spawning TBN in 0.051 s
2013-08-13 06:39:41 [DEBUG   ] Finished updating ant stats in 1.176 seconds
2013-08-13 06:40:01 [DEBUG   ] Finished updating ant stats in 0.985 seconds
2013-08-13 06:40:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:40:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769703448000000
2013-08-13 06:40:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:40:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:40:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:40:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:40:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769703448000000
2013-08-13 06:40:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:40:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769703644000000
2013-08-13 06:40:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:40:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:40:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:40:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:40:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769703644000000
2013-08-13 06:40:08 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:40:08 [DEBUG   ] Finished updating board flags in 1.747 seconds
2013-08-13 06:40:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 06:40:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 06:41:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 06:41:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:41:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769715208000000
2013-08-13 06:41:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:41:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:41:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:41:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:41:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769715208000000
2013-08-13 06:41:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:41:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769715404000000
2013-08-13 06:41:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:41:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:41:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:41:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:41:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769715404000000
2013-08-13 06:41:08 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:41:08 [DEBUG   ] Finished updating board flags in 1.597 seconds
2013-08-13 06:41:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-13 06:41:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 06:41:58 [DEBUG   ] Got command TBW from MCS: ref #18908
2013-08-13 06:41:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 06:41:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18908   8 56517 24118011 A  ERROR'
2013-08-13 06:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 06:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 06:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 06:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 06:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 06:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 06:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 06:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 06:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 06:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 06:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 06:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 06:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 06:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 06:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 06:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 06:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 06:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 06:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 06:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 06:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 06:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 06:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 06:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 06:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 06:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 06:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 06:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 06:42:01 [DEBUG   ] spawn_process: at 2013-08-13 06:42:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 06:42:01 [INFO    ] Finished spawning TBW
2013-08-13 06:42:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:42:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769727164000000
2013-08-13 06:42:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:42:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:42:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:42:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:42:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769727164000000
2013-08-13 06:42:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:42:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769727164000000
2013-08-13 06:42:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:42:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:42:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:42:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:42:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769727164000000
2013-08-13 06:42:08 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:42:08 [DEBUG   ] Finished updating board flags in 1.204 seconds
2013-08-13 06:43:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:43:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769738924000000
2013-08-13 06:43:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:43:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:43:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:43:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:43:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769738924000000
2013-08-13 06:43:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:43:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769738924000000
2013-08-13 06:43:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:43:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:43:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:43:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:43:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769738924000000
2013-08-13 06:43:08 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:43:08 [DEBUG   ] Finished updating board flags in 1.331 seconds
2013-08-13 06:44:01 [DEBUG   ] Got command RPT from MCS: ref #18910
2013-08-13 06:44:01 [DEBUG   ] summary = ERROR
2013-08-13 06:44:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18910  13 56517 24241351 A  ERRORERROR'
2013-08-13 06:44:01 [DEBUG   ] Got command RPT from MCS: ref #18911
2013-08-13 06:44:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 06:44:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18911  79 56517 24241351 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 06:44:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:44:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769750684000000
2013-08-13 06:44:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:44:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:44:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:44:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:44:07 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769750684000000
2013-08-13 06:44:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:44:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769750684000000
2013-08-13 06:44:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:44:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:44:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:44:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:44:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769750684000000
2013-08-13 06:44:08 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:44:08 [DEBUG   ] Finished updating board flags in 1.073 seconds
2013-08-13 06:45:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:45:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769762444000000
2013-08-13 06:45:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:45:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:45:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:45:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:45:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769762444000000
2013-08-13 06:45:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:45:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769762640000000
2013-08-13 06:45:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:45:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:45:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:45:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:45:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769762640000000
2013-08-13 06:45:09 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:45:09 [DEBUG   ] Finished updating board flags in 2.119 seconds
2013-08-13 06:45:41 [INFO    ] __waitForTBW - TBW finished in 219.489 s
2013-08-13 06:45:42 [INFO    ] Started antennas statistics background thread
2013-08-13 06:45:42 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376376343']
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376376343']
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376376343']
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376376343']
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376376343']
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376376343']
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376376343']
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376376343']
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376376343']
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376376343']
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376376343']
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376376343']
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376376343']
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376376343']
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376376343']
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376376343']
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376376343']
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376376343']
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376376343']
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376376343']
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376376343']
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376376343']
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376376343']
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376376343']
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376376343']
2013-08-13 06:45:42 [DEBUG   ] spawn_process: at 2013-08-13 06:45:42 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376376343']
2013-08-13 06:45:42 [INFO    ] Finished spawning TBN in 0.049 s
2013-08-13 06:45:42 [DEBUG   ] Finished updating ant stats in 1.232 seconds
2013-08-13 06:46:02 [DEBUG   ] Finished updating ant stats in 1.182 seconds
2013-08-13 06:46:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:46:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769774204000000
2013-08-13 06:46:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:46:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:46:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:46:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:46:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769774204000000
2013-08-13 06:46:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:46:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769774400000000
2013-08-13 06:46:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:46:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:46:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:46:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:46:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769774400000000
2013-08-13 06:46:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 3
2013-08-13 06:46:09 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:46:09 [DEBUG   ] Finished updating board flags in 2.225 seconds
2013-08-13 06:46:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 06:46:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 06:47:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 06:47:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:47:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769785964000000
2013-08-13 06:47:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:47:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:47:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:47:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:47:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769785964000000
2013-08-13 06:47:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:47:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769786160000000
2013-08-13 06:47:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:47:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:47:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:47:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:47:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769786160000000
2013-08-13 06:47:09 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:47:09 [DEBUG   ] Finished updating board flags in 2.083 seconds
2013-08-13 06:47:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 06:47:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 06:47:58 [DEBUG   ] Got command TBW from MCS: ref #18928
2013-08-13 06:47:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 06:47:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18928   8 56517 24478011 A  ERROR'
2013-08-13 06:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 06:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 06:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 06:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 06:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 06:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 06:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 06:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 06:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 06:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 06:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 06:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 06:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 06:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 06:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 06:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 06:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 06:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 06:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 06:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 06:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 06:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 06:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 06:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 06:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 06:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 06:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 06:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 06:48:01 [DEBUG   ] spawn_process: at 2013-08-13 06:48:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 06:48:01 [INFO    ] Finished spawning TBW
2013-08-13 06:48:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:48:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769797724000000
2013-08-13 06:48:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:48:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:48:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:48:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:48:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769797724000000
2013-08-13 06:48:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:48:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769797920000000
2013-08-13 06:48:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:48:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:48:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:48:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:48:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769797920000000
2013-08-13 06:48:09 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:48:09 [DEBUG   ] Finished updating board flags in 1.788 seconds
2013-08-13 06:49:01 [DEBUG   ] Got command RPT from MCS: ref #18930
2013-08-13 06:49:01 [DEBUG   ] summary = ERROR
2013-08-13 06:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18930  13 56517 24541355 A  ERRORERROR'
2013-08-13 06:49:01 [DEBUG   ] Got command RPT from MCS: ref #18931
2013-08-13 06:49:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 06:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18931  79 56517 24541355 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 06:49:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:49:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769809484000000
2013-08-13 06:49:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:49:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:49:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:49:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:49:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769809484000000
2013-08-13 06:49:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:49:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769809680000000
2013-08-13 06:49:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:49:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:49:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:49:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:49:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769809680000000
2013-08-13 06:49:09 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:49:09 [DEBUG   ] Finished updating board flags in 1.716 seconds
2013-08-13 06:50:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:50:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769821244000000
2013-08-13 06:50:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:50:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:50:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:50:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:50:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769821244000000
2013-08-13 06:50:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:50:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769821440000000
2013-08-13 06:50:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:50:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:50:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:50:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:50:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769821440000000
2013-08-13 06:50:09 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:50:09 [DEBUG   ] Finished updating board flags in 1.492 seconds
2013-08-13 06:51:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:51:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769833004000000
2013-08-13 06:51:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:51:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:51:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:51:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:51:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769833004000000
2013-08-13 06:51:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:51:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769833200000000
2013-08-13 06:51:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:51:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:51:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:51:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:51:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769833200000000
2013-08-13 06:51:09 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:51:09 [DEBUG   ] Finished updating board flags in 1.509 seconds
2013-08-13 06:51:40 [INFO    ] __waitForTBW - TBW finished in 218.939 s
2013-08-13 06:51:41 [DEBUG   ] Finished updating ant stats in 0.807 seconds
2013-08-13 06:51:41 [INFO    ] Started antennas statistics background thread
2013-08-13 06:51:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376376702']
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376376702']
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376376702']
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376376702']
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376376702']
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376376702']
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376376702']
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376376702']
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376376702']
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376376702']
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376376702']
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376376702']
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376376702']
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376376702']
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376376702']
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376376702']
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376376702']
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376376702']
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376376702']
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376376702']
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376376702']
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376376702']
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376376702']
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376376702']
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376376702']
2013-08-13 06:51:41 [DEBUG   ] spawn_process: at 2013-08-13 06:51:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376376702']
2013-08-13 06:51:41 [INFO    ] Finished spawning TBN in 0.047 s
2013-08-13 06:52:01 [DEBUG   ] Finished updating ant stats in 0.868 seconds
2013-08-13 06:52:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:52:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769844960000000
2013-08-13 06:52:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:52:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:52:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:52:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:52:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769844960000000
2013-08-13 06:52:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:52:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769844960000000
2013-08-13 06:52:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:52:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:52:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:52:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:52:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769844960000000
2013-08-13 06:52:09 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:52:09 [DEBUG   ] Finished updating board flags in 1.630 seconds
2013-08-13 06:52:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-08-13 06:52:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 06:53:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-13 06:53:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:53:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769856720000000
2013-08-13 06:53:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:53:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:53:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:53:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:53:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769856720000000
2013-08-13 06:53:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:53:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769856720000000
2013-08-13 06:53:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:53:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:53:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:53:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:53:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769856720000000
2013-08-13 06:53:09 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:53:09 [DEBUG   ] Finished updating board flags in 1.625 seconds
2013-08-13 06:53:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 06:53:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 06:53:58 [DEBUG   ] Got command TBW from MCS: ref #18948
2013-08-13 06:53:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 06:53:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18948   8 56517 24838015 A  ERROR'
2013-08-13 06:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 06:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 06:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 06:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 06:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 06:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 06:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 06:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 06:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 06:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 06:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 06:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 06:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 06:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 06:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 06:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 06:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 06:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 06:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 06:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 06:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 06:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 06:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 06:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 06:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 06:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 06:54:01 [DEBUG   ] Got command RPT from MCS: ref #18950
2013-08-13 06:54:01 [DEBUG   ] summary = ERROR
2013-08-13 06:54:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18950  13 56517 24841359 A  ERRORERROR'
2013-08-13 06:54:01 [DEBUG   ] Got command RPT from MCS: ref #18951
2013-08-13 06:54:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 06:54:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18951  79 56517 24841359 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 06:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 06:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 06:54:01 [DEBUG   ] spawn_process: at 2013-08-13 06:54:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 06:54:01 [INFO    ] Finished spawning TBW
2013-08-13 06:54:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:54:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769868480000000
2013-08-13 06:54:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:54:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:54:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:54:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:54:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769868480000000
2013-08-13 06:54:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:54:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769868480000000
2013-08-13 06:54:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:54:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:54:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:54:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:54:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769868480000000
2013-08-13 06:54:09 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:54:09 [DEBUG   ] Finished updating board flags in 1.224 seconds
2013-08-13 06:55:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:55:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769880240000000
2013-08-13 06:55:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:55:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:55:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:55:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:55:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769880240000000
2013-08-13 06:55:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:55:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769880240000000
2013-08-13 06:55:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:55:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:55:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:55:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:55:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769880240000000
2013-08-13 06:55:09 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:55:09 [DEBUG   ] Finished updating board flags in 1.324 seconds
2013-08-13 06:56:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:56:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769892000000000
2013-08-13 06:56:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:56:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:56:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:56:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:56:08 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769892000000000
2013-08-13 06:56:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:56:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769892000000000
2013-08-13 06:56:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:56:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:56:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:56:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:56:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769892000000000
2013-08-13 06:56:09 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:56:09 [DEBUG   ] Finished updating board flags in 1.090 seconds
2013-08-13 06:57:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:57:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769903760000000
2013-08-13 06:57:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:57:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:57:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:57:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:57:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769903760000000
2013-08-13 06:57:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:57:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769903956000000
2013-08-13 06:57:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:57:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:57:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:57:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:57:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769903956000000
2013-08-13 06:57:10 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:57:10 [DEBUG   ] Finished updating board flags in 2.121 seconds
2013-08-13 06:57:41 [INFO    ] __waitForTBW - TBW finished in 219.905 s
2013-08-13 06:57:42 [DEBUG   ] Finished updating ant stats in 0.838 seconds
2013-08-13 06:57:42 [INFO    ] Started antennas statistics background thread
2013-08-13 06:57:42 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376377063']
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376377063']
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376377063']
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376377063']
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376377063']
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376377063']
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376377063']
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376377063']
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376377063']
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376377063']
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376377063']
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376377063']
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376377063']
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376377063']
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376377063']
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376377063']
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376377063']
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376377063']
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376377063']
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376377063']
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376377063']
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376377063']
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376377063']
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376377063']
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376377063']
2013-08-13 06:57:42 [DEBUG   ] spawn_process: at 2013-08-13 06:57:42 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376377063']
2013-08-13 06:57:42 [INFO    ] Finished spawning TBN in 0.047 s
2013-08-13 06:58:02 [DEBUG   ] Finished updating ant stats in 0.869 seconds
2013-08-13 06:58:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164255077
2013-08-13 06:58:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769915520000000
2013-08-13 06:58:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164207072
2013-08-13 06:58:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164259061
2013-08-13 06:58:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244210
2013-08-13 06:58:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257455
2013-08-13 06:58:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769915520000000
2013-08-13 06:58:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164157003
2013-08-13 06:58:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769915716000000
2013-08-13 06:58:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123607
2013-08-13 06:58:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148426
2013-08-13 06:58:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158130
2013-08-13 06:58:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162268
2013-08-13 06:58:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769915716000000
2013-08-13 06:58:10 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:58:10 [DEBUG   ] Finished updating board flags in 2.215 seconds
2013-08-13 06:58:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 06:58:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 06:59:01 [DEBUG   ] Got command RPT from MCS: ref #18967
2013-08-13 06:59:01 [DEBUG   ] summary = ERROR
2013-08-13 06:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18967  13 56517 25141355 A  ERRORERROR'
2013-08-13 06:59:01 [DEBUG   ] Got command RPT from MCS: ref #18968
2013-08-13 06:59:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 06:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18968  79 56517 25141355 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 06:59:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769927280000000
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206974
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258963
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244112
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257357
2013-08-13 06:59:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769927280000000
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-08-13 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156905
2013-08-13 06:59:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769927476000000
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123509
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148328
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158032
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162170
2013-08-13 06:59:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769927476000000
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-08-13 06:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-08-13 06:59:10 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 06:59:10 [DEBUG   ] Finished updating board flags in 2.064 seconds
2013-08-13 06:59:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 06:59:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 06:59:58 [DEBUG   ] Got command TBW from MCS: ref #18985
2013-08-13 06:59:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 06:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    18985   8 56517 25198011 A  ERROR'
2013-08-13 06:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 06:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 06:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 06:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 06:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 07:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 07:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 07:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 07:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 07:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 07:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 07:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 07:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 07:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 07:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 07:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 07:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 07:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 07:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 07:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 07:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 07:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 07:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 07:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 07:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 07:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 07:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 07:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 07:00:01 [DEBUG   ] spawn_process: at 2013-08-13 07:00:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 07:00:01 [INFO    ] Finished spawning TBW
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254979
2013-08-13 07:00:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769939040000000
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206974
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258963
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244112
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257357
2013-08-13 07:00:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769939040000000
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-13 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156905
2013-08-13 07:00:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769939236000000
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123509
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148328
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158032
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162170
2013-08-13 07:00:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769939236000000
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-13 07:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-13 07:00:10 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:00:10 [DEBUG   ] Finished updating board flags in 1.898 seconds
2013-08-13 07:01:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254979
2013-08-13 07:01:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769950800000000
2013-08-13 07:01:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206974
2013-08-13 07:01:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258963
2013-08-13 07:01:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244112
2013-08-13 07:01:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257357
2013-08-13 07:01:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769950800000000
2013-08-13 07:01:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156905
2013-08-13 07:01:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769950996000000
2013-08-13 07:01:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123509
2013-08-13 07:01:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148328
2013-08-13 07:01:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158032
2013-08-13 07:01:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162170
2013-08-13 07:01:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769950996000000
2013-08-13 07:01:10 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:01:10 [DEBUG   ] Finished updating board flags in 1.824 seconds
2013-08-13 07:02:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254979
2013-08-13 07:02:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769962560000000
2013-08-13 07:02:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206974
2013-08-13 07:02:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258963
2013-08-13 07:02:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244112
2013-08-13 07:02:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257357
2013-08-13 07:02:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769962560000000
2013-08-13 07:02:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156905
2013-08-13 07:02:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769962756000000
2013-08-13 07:02:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123509
2013-08-13 07:02:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148328
2013-08-13 07:02:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158032
2013-08-13 07:02:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162170
2013-08-13 07:02:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769962756000000
2013-08-13 07:02:10 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:02:10 [DEBUG   ] Finished updating board flags in 1.806 seconds
2013-08-13 07:03:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254979
2013-08-13 07:03:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769974320000000
2013-08-13 07:03:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206974
2013-08-13 07:03:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258963
2013-08-13 07:03:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244112
2013-08-13 07:03:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257357
2013-08-13 07:03:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769974320000000
2013-08-13 07:03:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156905
2013-08-13 07:03:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769974516000000
2013-08-13 07:03:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123509
2013-08-13 07:03:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148328
2013-08-13 07:03:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158032
2013-08-13 07:03:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162170
2013-08-13 07:03:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769974516000000
2013-08-13 07:03:10 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:03:10 [DEBUG   ] Finished updating board flags in 1.672 seconds
2013-08-13 07:03:40 [INFO    ] __waitForTBW - TBW finished in 218.793 s
2013-08-13 07:03:41 [DEBUG   ] Finished updating ant stats in 0.949 seconds
2013-08-13 07:03:41 [INFO    ] Started antennas statistics background thread
2013-08-13 07:03:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376377422']
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376377422']
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376377422']
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376377422']
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376377422']
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376377422']
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376377422']
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376377422']
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376377422']
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376377422']
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376377422']
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376377422']
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376377422']
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376377422']
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376377422']
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376377422']
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376377422']
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376377422']
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376377422']
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376377422']
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376377422']
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376377422']
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376377422']
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376377422']
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376377422']
2013-08-13 07:03:41 [DEBUG   ] spawn_process: at 2013-08-13 07:03:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376377422']
2013-08-13 07:03:41 [INFO    ] Finished spawning TBN in 0.047 s
2013-08-13 07:04:01 [DEBUG   ] Finished updating ant stats in 0.870 seconds
2013-08-13 07:04:01 [DEBUG   ] Got command RPT from MCS: ref #18987
2013-08-13 07:04:01 [DEBUG   ] summary = ERROR
2013-08-13 07:04:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18987  13 56517 25441351 A  ERRORERROR'
2013-08-13 07:04:01 [DEBUG   ] Got command RPT from MCS: ref #18988
2013-08-13 07:04:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 07:04:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    18988  79 56517 25441351 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 07:04:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254979
2013-08-13 07:04:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769986080000000
2013-08-13 07:04:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206974
2013-08-13 07:04:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258963
2013-08-13 07:04:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244112
2013-08-13 07:04:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257357
2013-08-13 07:04:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769986080000000
2013-08-13 07:04:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156905
2013-08-13 07:04:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769986276000000
2013-08-13 07:04:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123509
2013-08-13 07:04:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148328
2013-08-13 07:04:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158032
2013-08-13 07:04:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162170
2013-08-13 07:04:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769986276000000
2013-08-13 07:04:10 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:04:10 [DEBUG   ] Finished updating board flags in 1.807 seconds
2013-08-13 07:04:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 07:04:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 07:05:01 [DEBUG   ] Finished updating ant stats in 1.128 seconds
2013-08-13 07:05:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254979
2013-08-13 07:05:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269769997840000000
2013-08-13 07:05:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206974
2013-08-13 07:05:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258963
2013-08-13 07:05:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244112
2013-08-13 07:05:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257357
2013-08-13 07:05:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269769997840000000
2013-08-13 07:05:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156905
2013-08-13 07:05:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269769998036000000
2013-08-13 07:05:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123509
2013-08-13 07:05:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148328
2013-08-13 07:05:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158032
2013-08-13 07:05:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162170
2013-08-13 07:05:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269769998036000000
2013-08-13 07:05:10 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:05:10 [DEBUG   ] Finished updating board flags in 1.815 seconds
2013-08-13 07:05:21 [DEBUG   ] Finished updating ant stats in 0.677 seconds
2013-08-13 07:05:41 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-13 07:05:58 [DEBUG   ] Got command TBW from MCS: ref #19005
2013-08-13 07:05:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 07:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19005   8 56517 25558019 A  ERROR'
2013-08-13 07:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 07:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 07:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 07:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 07:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 07:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 07:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 07:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 07:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 07:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 07:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 07:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 07:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 07:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 07:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 07:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 07:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 07:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 07:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 07:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 07:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 07:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 07:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 07:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 07:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 07:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 07:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 07:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 07:06:01 [DEBUG   ] spawn_process: at 2013-08-13 07:06:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 07:06:01 [INFO    ] Finished spawning TBW
2013-08-13 07:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254979
2013-08-13 07:06:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770009600000000
2013-08-13 07:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206974
2013-08-13 07:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258963
2013-08-13 07:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244112
2013-08-13 07:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257357
2013-08-13 07:06:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770009600000000
2013-08-13 07:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156905
2013-08-13 07:06:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770009796000000
2013-08-13 07:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123509
2013-08-13 07:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148328
2013-08-13 07:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158032
2013-08-13 07:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162170
2013-08-13 07:06:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770009796000000
2013-08-13 07:06:09 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:06:09 [DEBUG   ] Finished updating board flags in 1.057 seconds
2013-08-13 07:07:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254979
2013-08-13 07:07:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770021360000000
2013-08-13 07:07:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206974
2013-08-13 07:07:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258963
2013-08-13 07:07:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244112
2013-08-13 07:07:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257357
2013-08-13 07:07:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770021360000000
2013-08-13 07:07:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156905
2013-08-13 07:07:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770021556000000
2013-08-13 07:07:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123509
2013-08-13 07:07:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148328
2013-08-13 07:07:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158032
2013-08-13 07:07:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162170
2013-08-13 07:07:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770021556000000
2013-08-13 07:07:10 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:07:10 [DEBUG   ] Finished updating board flags in 1.667 seconds
2013-08-13 07:08:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254979
2013-08-13 07:08:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770033120000000
2013-08-13 07:08:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206974
2013-08-13 07:08:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258963
2013-08-13 07:08:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244112
2013-08-13 07:08:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257357
2013-08-13 07:08:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770033120000000
2013-08-13 07:08:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156905
2013-08-13 07:08:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770033316000000
2013-08-13 07:08:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123509
2013-08-13 07:08:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148328
2013-08-13 07:08:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158032
2013-08-13 07:08:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162170
2013-08-13 07:08:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770033316000000
2013-08-13 07:08:10 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:08:10 [DEBUG   ] Finished updating board flags in 1.465 seconds
2013-08-13 07:09:01 [DEBUG   ] Got command RPT from MCS: ref #19007
2013-08-13 07:09:01 [DEBUG   ] summary = ERROR
2013-08-13 07:09:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19007  13 56517 25741359 A  ERRORERROR'
2013-08-13 07:09:01 [DEBUG   ] Got command RPT from MCS: ref #19008
2013-08-13 07:09:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 07:09:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19008  79 56517 25741359 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 07:09:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254979
2013-08-13 07:09:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770044880000000
2013-08-13 07:09:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206974
2013-08-13 07:09:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258963
2013-08-13 07:09:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244112
2013-08-13 07:09:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257357
2013-08-13 07:09:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770044880000000
2013-08-13 07:09:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156905
2013-08-13 07:09:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770045076000000
2013-08-13 07:09:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123509
2013-08-13 07:09:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148328
2013-08-13 07:09:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158032
2013-08-13 07:09:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162170
2013-08-13 07:09:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770045076000000
2013-08-13 07:09:10 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:09:10 [DEBUG   ] Finished updating board flags in 1.536 seconds
2013-08-13 07:09:40 [INFO    ] __waitForTBW - TBW finished in 218.560 s
2013-08-13 07:09:41 [INFO    ] Started antennas statistics background thread
2013-08-13 07:09:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376377782']
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376377782']
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376377782']
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376377782']
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376377782']
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376377782']
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376377782']
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376377782']
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376377782']
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376377782']
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376377782']
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376377782']
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376377782']
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376377782']
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376377782']
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376377782']
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376377782']
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376377782']
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376377782']
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376377782']
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376377782']
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376377782']
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376377782']
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376377782']
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376377782']
2013-08-13 07:09:41 [DEBUG   ] spawn_process: at 2013-08-13 07:09:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376377782']
2013-08-13 07:09:41 [INFO    ] Finished spawning TBN in 0.050 s
2013-08-13 07:09:41 [DEBUG   ] Finished updating ant stats in 1.251 seconds
2013-08-13 07:10:01 [DEBUG   ] Finished updating ant stats in 1.186 seconds
2013-08-13 07:10:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254979
2013-08-13 07:10:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770056836000000
2013-08-13 07:10:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206974
2013-08-13 07:10:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258963
2013-08-13 07:10:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244112
2013-08-13 07:10:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257357
2013-08-13 07:10:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770056836000000
2013-08-13 07:10:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156905
2013-08-13 07:10:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770056836000000
2013-08-13 07:10:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123509
2013-08-13 07:10:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148328
2013-08-13 07:10:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158032
2013-08-13 07:10:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162170
2013-08-13 07:10:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770056836000000
2013-08-13 07:10:10 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:10:10 [DEBUG   ] Finished updating board flags in 1.629 seconds
2013-08-13 07:10:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 07:10:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 07:11:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 07:11:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254979
2013-08-13 07:11:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770068596000000
2013-08-13 07:11:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206974
2013-08-13 07:11:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258963
2013-08-13 07:11:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244112
2013-08-13 07:11:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257357
2013-08-13 07:11:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770068596000000
2013-08-13 07:11:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156905
2013-08-13 07:11:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770068596000000
2013-08-13 07:11:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123509
2013-08-13 07:11:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148328
2013-08-13 07:11:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158032
2013-08-13 07:11:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162170
2013-08-13 07:11:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770068596000000
2013-08-13 07:11:10 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:11:10 [DEBUG   ] Finished updating board flags in 1.636 seconds
2013-08-13 07:11:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 07:11:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 07:11:58 [DEBUG   ] Got command TBW from MCS: ref #19025
2013-08-13 07:11:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 07:11:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19025   8 56517 25918015 A  ERROR'
2013-08-13 07:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 07:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 07:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 07:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 07:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 07:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 07:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 07:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 07:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 07:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 07:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 07:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 07:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 07:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 07:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 07:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 07:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 07:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 07:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 07:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 07:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 07:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 07:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 07:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 07:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 07:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 07:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 07:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 07:12:01 [DEBUG   ] spawn_process: at 2013-08-13 07:12:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 07:12:01 [INFO    ] Finished spawning TBW
2013-08-13 07:12:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254979
2013-08-13 07:12:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770080356000000
2013-08-13 07:12:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206974
2013-08-13 07:12:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258963
2013-08-13 07:12:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244112
2013-08-13 07:12:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257357
2013-08-13 07:12:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770080356000000
2013-08-13 07:12:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156905
2013-08-13 07:12:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770080356000000
2013-08-13 07:12:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123509
2013-08-13 07:12:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148328
2013-08-13 07:12:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158032
2013-08-13 07:12:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162170
2013-08-13 07:12:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770080356000000
2013-08-13 07:12:10 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:12:10 [DEBUG   ] Finished updating board flags in 1.209 seconds
2013-08-13 07:13:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254979
2013-08-13 07:13:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770092116000000
2013-08-13 07:13:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206974
2013-08-13 07:13:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258963
2013-08-13 07:13:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244112
2013-08-13 07:13:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257357
2013-08-13 07:13:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770092116000000
2013-08-13 07:13:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156905
2013-08-13 07:13:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770092116000000
2013-08-13 07:13:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123509
2013-08-13 07:13:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148328
2013-08-13 07:13:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158032
2013-08-13 07:13:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162170
2013-08-13 07:13:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770092116000000
2013-08-13 07:13:10 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:13:10 [DEBUG   ] Finished updating board flags in 1.327 seconds
2013-08-13 07:14:01 [DEBUG   ] Got command RPT from MCS: ref #19027
2013-08-13 07:14:01 [DEBUG   ] summary = ERROR
2013-08-13 07:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19027  13 56517 26041363 A  ERRORERROR'
2013-08-13 07:14:01 [DEBUG   ] Got command RPT from MCS: ref #19028
2013-08-13 07:14:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 07:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19028  79 56517 26041363 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 07:14:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254979
2013-08-13 07:14:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770103876000000
2013-08-13 07:14:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206974
2013-08-13 07:14:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258963
2013-08-13 07:14:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244112
2013-08-13 07:14:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257357
2013-08-13 07:14:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770103876000000
2013-08-13 07:14:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156905
2013-08-13 07:14:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770103876000000
2013-08-13 07:14:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123509
2013-08-13 07:14:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148328
2013-08-13 07:14:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158032
2013-08-13 07:14:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162170
2013-08-13 07:14:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770103876000000
2013-08-13 07:14:10 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:14:10 [DEBUG   ] Finished updating board flags in 1.069 seconds
2013-08-13 07:15:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254979
2013-08-13 07:15:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770115636000000
2013-08-13 07:15:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206974
2013-08-13 07:15:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258963
2013-08-13 07:15:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244112
2013-08-13 07:15:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257357
2013-08-13 07:15:09 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770115636000000
2013-08-13 07:15:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156905
2013-08-13 07:15:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770115636000000
2013-08-13 07:15:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123509
2013-08-13 07:15:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148328
2013-08-13 07:15:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158032
2013-08-13 07:15:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162170
2013-08-13 07:15:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770115636000000
2013-08-13 07:15:10 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:15:10 [DEBUG   ] Finished updating board flags in 1.209 seconds
2013-08-13 07:15:39 [INFO    ] __waitForTBW - TBW finished in 218.488 s
2013-08-13 07:15:40 [INFO    ] Started antennas statistics background thread
2013-08-13 07:15:40 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 07:15:40 [DEBUG   ] spawn_process: at 2013-08-13 07:15:40 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376378142']
2013-08-13 07:15:40 [DEBUG   ] spawn_process: at 2013-08-13 07:15:40 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376378142']
2013-08-13 07:15:40 [DEBUG   ] spawn_process: at 2013-08-13 07:15:40 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376378142']
2013-08-13 07:15:40 [DEBUG   ] spawn_process: at 2013-08-13 07:15:40 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376378142']
2013-08-13 07:15:40 [DEBUG   ] spawn_process: at 2013-08-13 07:15:40 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376378142']
2013-08-13 07:15:40 [DEBUG   ] spawn_process: at 2013-08-13 07:15:40 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376378142']
2013-08-13 07:15:40 [DEBUG   ] spawn_process: at 2013-08-13 07:15:40 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376378142']
2013-08-13 07:15:41 [DEBUG   ] spawn_process: at 2013-08-13 07:15:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376378142']
2013-08-13 07:15:41 [DEBUG   ] spawn_process: at 2013-08-13 07:15:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376378142']
2013-08-13 07:15:41 [DEBUG   ] spawn_process: at 2013-08-13 07:15:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376378142']
2013-08-13 07:15:41 [DEBUG   ] spawn_process: at 2013-08-13 07:15:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376378142']
2013-08-13 07:15:41 [DEBUG   ] spawn_process: at 2013-08-13 07:15:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376378142']
2013-08-13 07:15:41 [DEBUG   ] spawn_process: at 2013-08-13 07:15:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376378142']
2013-08-13 07:15:41 [DEBUG   ] spawn_process: at 2013-08-13 07:15:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376378142']
2013-08-13 07:15:41 [DEBUG   ] spawn_process: at 2013-08-13 07:15:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376378142']
2013-08-13 07:15:41 [DEBUG   ] spawn_process: at 2013-08-13 07:15:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376378142']
2013-08-13 07:15:41 [DEBUG   ] spawn_process: at 2013-08-13 07:15:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376378142']
2013-08-13 07:15:41 [DEBUG   ] spawn_process: at 2013-08-13 07:15:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376378142']
2013-08-13 07:15:41 [DEBUG   ] spawn_process: at 2013-08-13 07:15:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376378142']
2013-08-13 07:15:41 [DEBUG   ] spawn_process: at 2013-08-13 07:15:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376378142']
2013-08-13 07:15:41 [DEBUG   ] spawn_process: at 2013-08-13 07:15:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376378142']
2013-08-13 07:15:41 [DEBUG   ] spawn_process: at 2013-08-13 07:15:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376378142']
2013-08-13 07:15:41 [DEBUG   ] spawn_process: at 2013-08-13 07:15:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376378142']
2013-08-13 07:15:41 [DEBUG   ] spawn_process: at 2013-08-13 07:15:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376378142']
2013-08-13 07:15:41 [DEBUG   ] spawn_process: at 2013-08-13 07:15:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376378142']
2013-08-13 07:15:41 [DEBUG   ] spawn_process: at 2013-08-13 07:15:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376378142']
2013-08-13 07:15:41 [INFO    ] Finished spawning TBN in 0.052 s
2013-08-13 07:15:41 [DEBUG   ] Finished updating ant stats in 1.271 seconds
2013-08-13 07:16:01 [DEBUG   ] Finished updating ant stats in 1.261 seconds
2013-08-13 07:16:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254979
2013-08-13 07:16:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770127396000000
2013-08-13 07:16:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206974
2013-08-13 07:16:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258963
2013-08-13 07:16:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244112
2013-08-13 07:16:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257357
2013-08-13 07:16:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770127396000000
2013-08-13 07:16:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156905
2013-08-13 07:16:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770127592000000
2013-08-13 07:16:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123509
2013-08-13 07:16:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148328
2013-08-13 07:16:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158032
2013-08-13 07:16:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162170
2013-08-13 07:16:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770127592000000
2013-08-13 07:16:11 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:16:11 [DEBUG   ] Finished updating board flags in 2.340 seconds
2013-08-13 07:16:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-13 07:16:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 07:17:01 [DEBUG   ] Finished updating ant stats in 1.272 seconds
2013-08-13 07:17:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254979
2013-08-13 07:17:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770139156000000
2013-08-13 07:17:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206974
2013-08-13 07:17:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258963
2013-08-13 07:17:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244112
2013-08-13 07:17:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257357
2013-08-13 07:17:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770139156000000
2013-08-13 07:17:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156905
2013-08-13 07:17:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770139352000000
2013-08-13 07:17:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123509
2013-08-13 07:17:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148328
2013-08-13 07:17:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158032
2013-08-13 07:17:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162170
2013-08-13 07:17:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770139352000000
2013-08-13 07:17:11 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:17:11 [DEBUG   ] Finished updating board flags in 2.211 seconds
2013-08-13 07:17:21 [DEBUG   ] Finished updating ant stats in 1.132 seconds
2013-08-13 07:17:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 07:17:58 [DEBUG   ] Got command TBW from MCS: ref #19045
2013-08-13 07:17:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 07:17:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19045   8 56517 26278007 A  ERROR'
2013-08-13 07:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 07:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 07:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 07:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 07:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 07:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 07:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 07:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 07:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 07:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 07:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 07:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 07:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 07:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 07:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 07:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 07:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 07:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 07:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 07:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 07:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 07:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 07:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 07:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 07:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 07:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 07:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 07:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 07:18:01 [DEBUG   ] spawn_process: at 2013-08-13 07:18:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 07:18:01 [INFO    ] Finished spawning TBW
2013-08-13 07:18:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254979
2013-08-13 07:18:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770150916000000
2013-08-13 07:18:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206974
2013-08-13 07:18:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258963
2013-08-13 07:18:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244112
2013-08-13 07:18:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257357
2013-08-13 07:18:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770150916000000
2013-08-13 07:18:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156905
2013-08-13 07:18:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770151112000000
2013-08-13 07:18:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123509
2013-08-13 07:18:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148328
2013-08-13 07:18:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164158032
2013-08-13 07:18:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162170
2013-08-13 07:18:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770151112000000
2013-08-13 07:18:11 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:18:11 [DEBUG   ] Finished updating board flags in 1.849 seconds
2013-08-13 07:19:01 [DEBUG   ] Got command RPT from MCS: ref #19047
2013-08-13 07:19:01 [DEBUG   ] summary = ERROR
2013-08-13 07:19:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19047  13 56517 26341363 A  ERRORERROR'
2013-08-13 07:19:01 [DEBUG   ] Got command RPT from MCS: ref #19048
2013-08-13 07:19:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 07:19:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19048  79 56517 26341363 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:19:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770162676000000
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:19:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770162676000000
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-08-13 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:19:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770162872000000
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:19:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770162872000000
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-08-13 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-08-13 07:19:11 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:19:11 [DEBUG   ] Finished updating board flags in 1.951 seconds
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:20:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770174436000000
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:20:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770174436000000
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-13 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:20:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770174632000000
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:20:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770174632000000
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-13 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-13 07:20:11 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:20:11 [DEBUG   ] Finished updating board flags in 1.715 seconds
2013-08-13 07:21:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:21:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770186196000000
2013-08-13 07:21:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:21:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:21:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:21:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:21:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770186196000000
2013-08-13 07:21:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:21:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770186392000000
2013-08-13 07:21:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:21:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:21:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:21:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:21:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770186392000000
2013-08-13 07:21:11 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:21:11 [DEBUG   ] Finished updating board flags in 1.673 seconds
2013-08-13 07:21:40 [INFO    ] __waitForTBW - TBW finished in 219.130 s
2013-08-13 07:21:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-13 07:21:41 [INFO    ] Started antennas statistics background thread
2013-08-13 07:21:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376378503']
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376378503']
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376378503']
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376378503']
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376378503']
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376378503']
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376378503']
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376378503']
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376378503']
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376378503']
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376378503']
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376378503']
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376378503']
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376378503']
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376378503']
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376378503']
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376378503']
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376378503']
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376378503']
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376378503']
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376378503']
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376378503']
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376378503']
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376378503']
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376378503']
2013-08-13 07:21:41 [DEBUG   ] spawn_process: at 2013-08-13 07:21:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376378503']
2013-08-13 07:21:41 [INFO    ] Finished spawning TBN in 0.047 s
2013-08-13 07:22:01 [DEBUG   ] Finished updating ant stats in 0.673 seconds
2013-08-13 07:22:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:22:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770197956000000
2013-08-13 07:22:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:22:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:22:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:22:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:22:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770197956000000
2013-08-13 07:22:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:22:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770198152000000
2013-08-13 07:22:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:22:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:22:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:22:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:22:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770198152000000
2013-08-13 07:22:11 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:22:11 [DEBUG   ] Finished updating board flags in 1.813 seconds
2013-08-13 07:22:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-13 07:22:41 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-08-13 07:23:01 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-08-13 07:23:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:23:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770209716000000
2013-08-13 07:23:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:23:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:23:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:23:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:23:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770209716000000
2013-08-13 07:23:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2013-08-13 07:23:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:23:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770209912000000
2013-08-13 07:23:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:23:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:23:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:23:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:23:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770209912000000
2013-08-13 07:23:11 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:23:11 [DEBUG   ] Finished updating board flags in 1.658 seconds
2013-08-13 07:23:22 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-08-13 07:23:42 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-08-13 07:23:58 [DEBUG   ] Got command TBW from MCS: ref #19065
2013-08-13 07:23:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 07:23:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19065   8 56517 26638007 A  ERROR'
2013-08-13 07:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 07:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 07:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 07:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 07:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 07:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 07:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 07:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 07:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 07:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 07:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 07:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 07:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 07:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 07:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 07:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 07:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 07:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 07:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 07:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 07:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 07:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 07:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 07:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 07:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 07:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 07:24:01 [DEBUG   ] Got command RPT from MCS: ref #19067
2013-08-13 07:24:01 [DEBUG   ] summary = ERROR
2013-08-13 07:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19067  13 56517 26641355 A  ERRORERROR'
2013-08-13 07:24:01 [DEBUG   ] Got command RPT from MCS: ref #19068
2013-08-13 07:24:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 07:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19068  79 56517 26641355 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 07:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 07:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 07:24:01 [DEBUG   ] spawn_process: at 2013-08-13 07:24:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 07:24:01 [INFO    ] Finished spawning TBW
2013-08-13 07:24:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:24:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770221476000000
2013-08-13 07:24:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:24:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:24:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:24:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:24:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770221476000000
2013-08-13 07:24:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2013-08-13 07:24:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:24:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770221672000000
2013-08-13 07:24:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:24:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:24:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:24:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:24:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770221672000000
2013-08-13 07:24:11 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:24:11 [DEBUG   ] Finished updating board flags in 1.421 seconds
2013-08-13 07:25:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:25:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770233236000000
2013-08-13 07:25:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:25:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:25:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:25:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:25:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770233236000000
2013-08-13 07:25:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:25:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770233432000000
2013-08-13 07:25:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:25:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:25:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:25:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:25:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770233432000000
2013-08-13 07:25:11 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:25:11 [DEBUG   ] Finished updating board flags in 1.540 seconds
2013-08-13 07:26:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:26:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770245192000000
2013-08-13 07:26:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:26:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:26:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:26:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:26:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770245192000000
2013-08-13 07:26:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:26:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770245192000000
2013-08-13 07:26:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:26:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:26:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:26:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:26:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770245192000000
2013-08-13 07:26:11 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:26:11 [DEBUG   ] Finished updating board flags in 1.260 seconds
2013-08-13 07:27:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:27:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770256952000000
2013-08-13 07:27:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:27:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:27:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:27:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:27:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770256952000000
2013-08-13 07:27:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:27:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770256952000000
2013-08-13 07:27:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:27:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:27:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:27:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:27:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770256952000000
2013-08-13 07:27:11 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:27:11 [DEBUG   ] Finished updating board flags in 1.310 seconds
2013-08-13 07:27:41 [INFO    ] __waitForTBW - TBW finished in 219.783 s
2013-08-13 07:27:42 [DEBUG   ] Finished updating ant stats in 0.951 seconds
2013-08-13 07:27:42 [INFO    ] Started antennas statistics background thread
2013-08-13 07:27:42 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376378863']
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376378863']
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376378863']
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376378863']
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376378863']
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376378863']
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376378863']
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376378863']
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376378863']
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376378863']
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376378863']
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376378863']
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376378863']
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376378863']
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376378863']
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376378863']
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376378863']
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376378863']
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376378863']
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376378863']
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376378863']
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376378863']
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376378863']
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376378863']
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376378863']
2013-08-13 07:27:42 [DEBUG   ] spawn_process: at 2013-08-13 07:27:42 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376378863']
2013-08-13 07:27:42 [INFO    ] Finished spawning TBN in 0.047 s
2013-08-13 07:28:02 [DEBUG   ] Finished updating ant stats in 0.871 seconds
2013-08-13 07:28:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:28:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770268712000000
2013-08-13 07:28:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:28:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:28:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:28:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:28:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770268712000000
2013-08-13 07:28:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:28:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770268908000000
2013-08-13 07:28:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:28:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:28:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:28:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:28:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770268908000000
2013-08-13 07:28:11 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:28:11 [DEBUG   ] Finished updating board flags in 1.628 seconds
2013-08-13 07:28:22 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 07:28:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 07:29:01 [DEBUG   ] Got command RPT from MCS: ref #19084
2013-08-13 07:29:01 [DEBUG   ] summary = ERROR
2013-08-13 07:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19084  13 56517 26941359 A  ERRORERROR'
2013-08-13 07:29:01 [DEBUG   ] Got command RPT from MCS: ref #19085
2013-08-13 07:29:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 07:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19085  79 56517 26941359 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 07:29:02 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-08-13 07:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:29:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770280472000000
2013-08-13 07:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:29:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770280472000000
2013-08-13 07:29:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:29:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770280668000000
2013-08-13 07:29:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:29:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:29:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:29:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:29:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770280668000000
2013-08-13 07:29:12 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:29:12 [DEBUG   ] Finished updating board flags in 1.624 seconds
2013-08-13 07:29:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 07:29:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 07:29:58 [DEBUG   ] Got command TBW from MCS: ref #19102
2013-08-13 07:29:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 07:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19102   8 56517 26998011 A  ERROR'
2013-08-13 07:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 07:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 07:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 07:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 07:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 07:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 07:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 07:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 07:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 07:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 07:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 07:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 07:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 07:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 07:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 07:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 07:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 07:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 07:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 07:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 07:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 07:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 07:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 07:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 07:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 07:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 07:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 07:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 07:30:01 [DEBUG   ] spawn_process: at 2013-08-13 07:30:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 07:30:01 [INFO    ] Finished spawning TBW
2013-08-13 07:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:30:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770292232000000
2013-08-13 07:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:30:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:30:10 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770292232000000
2013-08-13 07:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:30:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770292232000000
2013-08-13 07:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:30:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770292232000000
2013-08-13 07:30:11 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:30:11 [DEBUG   ] Finished updating board flags in 1.046 seconds
2013-08-13 07:31:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:31:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770303992000000
2013-08-13 07:31:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:31:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:31:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:31:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:31:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770303992000000
2013-08-13 07:31:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:31:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770304188000000
2013-08-13 07:31:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:31:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:31:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:31:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:31:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770304188000000
2013-08-13 07:31:12 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:31:12 [DEBUG   ] Finished updating board flags in 2.112 seconds
2013-08-13 07:32:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:32:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770315752000000
2013-08-13 07:32:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:32:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:32:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:32:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:32:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770315752000000
2013-08-13 07:32:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:32:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770315948000000
2013-08-13 07:32:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:32:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:32:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:32:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:32:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770315948000000
2013-08-13 07:32:12 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:32:12 [DEBUG   ] Finished updating board flags in 1.880 seconds
2013-08-13 07:33:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:33:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770327512000000
2013-08-13 07:33:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:33:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:33:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:33:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:33:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770327512000000
2013-08-13 07:33:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:33:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770327708000000
2013-08-13 07:33:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:33:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:33:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:33:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:33:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770327708000000
2013-08-13 07:33:12 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:33:12 [DEBUG   ] Finished updating board flags in 1.935 seconds
2013-08-13 07:33:40 [INFO    ] __waitForTBW - TBW finished in 218.505 s
2013-08-13 07:33:41 [INFO    ] Started antennas statistics background thread
2013-08-13 07:33:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376379222']
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376379222']
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376379222']
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376379222']
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376379222']
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376379222']
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376379222']
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376379222']
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376379222']
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376379222']
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376379222']
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376379222']
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376379222']
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376379222']
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376379222']
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376379222']
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376379222']
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376379222']
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376379222']
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376379222']
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376379222']
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376379222']
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376379222']
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376379222']
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376379222']
2013-08-13 07:33:41 [DEBUG   ] spawn_process: at 2013-08-13 07:33:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376379222']
2013-08-13 07:33:41 [INFO    ] Finished spawning TBN in 0.053 s
2013-08-13 07:33:41 [DEBUG   ] Finished updating ant stats in 1.215 seconds
2013-08-13 07:34:01 [DEBUG   ] Finished updating ant stats in 1.187 seconds
2013-08-13 07:34:01 [DEBUG   ] Got command RPT from MCS: ref #19104
2013-08-13 07:34:01 [DEBUG   ] summary = ERROR
2013-08-13 07:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19104  13 56517 27241355 A  ERRORERROR'
2013-08-13 07:34:01 [DEBUG   ] Got command RPT from MCS: ref #19105
2013-08-13 07:34:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 07:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19105  79 56517 27241355 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 07:34:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:34:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770339272000000
2013-08-13 07:34:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:34:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:34:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:34:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:34:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770339272000000
2013-08-13 07:34:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:34:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770339468000000
2013-08-13 07:34:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:34:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:34:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:34:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:34:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770339468000000
2013-08-13 07:34:12 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:34:12 [DEBUG   ] Finished updating board flags in 2.006 seconds
2013-08-13 07:34:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-08-13 07:34:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 07:35:01 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2013-08-13 07:35:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:35:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770351032000000
2013-08-13 07:35:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:35:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:35:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:35:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:35:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770351032000000
2013-08-13 07:35:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:35:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770351228000000
2013-08-13 07:35:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:35:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:35:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:35:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:35:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770351228000000
2013-08-13 07:35:12 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:35:12 [DEBUG   ] Finished updating board flags in 1.890 seconds
2013-08-13 07:35:21 [DEBUG   ] Finished updating ant stats in 0.627 seconds
2013-08-13 07:35:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 07:35:58 [DEBUG   ] Got command TBW from MCS: ref #19122
2013-08-13 07:35:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 07:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19122   8 56517 27358007 A  ERROR'
2013-08-13 07:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 07:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 07:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 07:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 07:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 07:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 07:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 07:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 07:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 07:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 07:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 07:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 07:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 07:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 07:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 07:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 07:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 07:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 07:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 07:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 07:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 07:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 07:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 07:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 07:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 07:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 07:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 07:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 07:36:01 [DEBUG   ] spawn_process: at 2013-08-13 07:36:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 07:36:01 [INFO    ] Finished spawning TBW
2013-08-13 07:36:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:36:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770362792000000
2013-08-13 07:36:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:36:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:36:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:36:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:36:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770362792000000
2013-08-13 07:36:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:36:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770362988000000
2013-08-13 07:36:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:36:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:36:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:36:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:36:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770362988000000
2013-08-13 07:36:12 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:36:12 [DEBUG   ] Finished updating board flags in 1.375 seconds
2013-08-13 07:37:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:37:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770374748000000
2013-08-13 07:37:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:37:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:37:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:37:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:37:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770374748000000
2013-08-13 07:37:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:37:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770374748000000
2013-08-13 07:37:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:37:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:37:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:37:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:37:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770374748000000
2013-08-13 07:37:12 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:37:12 [DEBUG   ] Finished updating board flags in 1.316 seconds
2013-08-13 07:38:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:38:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770386508000000
2013-08-13 07:38:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:38:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:38:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:38:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:38:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770386508000000
2013-08-13 07:38:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:38:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770386508000000
2013-08-13 07:38:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:38:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:38:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:38:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:38:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770386508000000
2013-08-13 07:38:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 07:38:12 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:38:12 [DEBUG   ] Finished updating board flags in 1.074 seconds
2013-08-13 07:39:01 [DEBUG   ] Got command RPT from MCS: ref #19124
2013-08-13 07:39:01 [DEBUG   ] summary = ERROR
2013-08-13 07:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19124  13 56517 27541367 A  ERRORERROR'
2013-08-13 07:39:01 [DEBUG   ] Got command RPT from MCS: ref #19125
2013-08-13 07:39:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 07:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19125  79 56517 27541367 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:39:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770398268000000
2013-08-13 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:39:11 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770398268000000
2013-08-13 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:39:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770398268000000
2013-08-13 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:39:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770398268000000
2013-08-13 07:39:12 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:39:12 [DEBUG   ] Finished updating board flags in 1.204 seconds
2013-08-13 07:39:40 [INFO    ] __waitForTBW - TBW finished in 218.750 s
2013-08-13 07:39:41 [DEBUG   ] Finished updating ant stats in 0.978 seconds
2013-08-13 07:39:41 [INFO    ] Started antennas statistics background thread
2013-08-13 07:39:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376379582']
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376379582']
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376379582']
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376379582']
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376379582']
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376379582']
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376379582']
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376379582']
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376379582']
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376379582']
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376379582']
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376379582']
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376379582']
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376379582']
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376379582']
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376379582']
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376379582']
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376379582']
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376379582']
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376379582']
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376379582']
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376379582']
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376379582']
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376379582']
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376379582']
2013-08-13 07:39:41 [DEBUG   ] spawn_process: at 2013-08-13 07:39:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376379582']
2013-08-13 07:39:41 [INFO    ] Finished spawning TBN in 0.049 s
2013-08-13 07:40:01 [DEBUG   ] Finished updating ant stats in 0.873 seconds
2013-08-13 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:40:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770410028000000
2013-08-13 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:40:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770410028000000
2013-08-13 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:40:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770410224000000
2013-08-13 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:40:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770410224000000
2013-08-13 07:40:13 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:40:13 [DEBUG   ] Finished updating board flags in 2.344 seconds
2013-08-13 07:40:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 07:40:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 07:41:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 07:41:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:41:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770421788000000
2013-08-13 07:41:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:41:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:41:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:41:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:41:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770421788000000
2013-08-13 07:41:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:41:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770421984000000
2013-08-13 07:41:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:41:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:41:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:41:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:41:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770421984000000
2013-08-13 07:41:13 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:41:13 [DEBUG   ] Finished updating board flags in 2.060 seconds
2013-08-13 07:41:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 07:41:41 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-13 07:41:58 [DEBUG   ] Got command TBW from MCS: ref #19142
2013-08-13 07:41:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 07:41:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19142   8 56517 27718011 A  ERROR'
2013-08-13 07:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 07:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 07:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 07:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 07:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 07:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 07:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 07:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 07:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 07:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 07:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 07:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 07:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 07:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 07:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 07:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 07:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 07:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 07:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 07:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 07:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 07:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 07:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 07:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 07:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 07:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 07:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 07:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 07:42:01 [DEBUG   ] spawn_process: at 2013-08-13 07:42:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 07:42:01 [INFO    ] Finished spawning TBW
2013-08-13 07:42:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:42:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770433548000000
2013-08-13 07:42:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:42:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:42:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:42:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:42:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770433548000000
2013-08-13 07:42:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:42:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770433744000000
2013-08-13 07:42:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:42:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:42:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:42:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:42:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770433744000000
2013-08-13 07:42:13 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:42:13 [DEBUG   ] Finished updating board flags in 1.821 seconds
2013-08-13 07:43:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:43:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770445308000000
2013-08-13 07:43:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:43:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:43:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:43:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:43:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770445308000000
2013-08-13 07:43:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:43:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770445504000000
2013-08-13 07:43:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:43:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:43:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:43:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:43:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770445504000000
2013-08-13 07:43:13 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:43:13 [DEBUG   ] Finished updating board flags in 1.906 seconds
2013-08-13 07:44:01 [DEBUG   ] Got command RPT from MCS: ref #19144
2013-08-13 07:44:01 [DEBUG   ] summary = ERROR
2013-08-13 07:44:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19144  13 56517 27841359 A  ERRORERROR'
2013-08-13 07:44:01 [DEBUG   ] Got command RPT from MCS: ref #19145
2013-08-13 07:44:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 07:44:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19145  79 56517 27841359 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 07:44:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:44:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770457068000000
2013-08-13 07:44:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:44:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:44:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:44:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:44:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770457068000000
2013-08-13 07:44:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:44:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770457264000000
2013-08-13 07:44:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:44:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:44:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:44:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:44:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770457264000000
2013-08-13 07:44:12 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:44:12 [DEBUG   ] Finished updating board flags in 1.143 seconds
2013-08-13 07:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:45:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770468828000000
2013-08-13 07:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:45:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770468828000000
2013-08-13 07:45:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:45:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770469024000000
2013-08-13 07:45:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:45:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:45:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:45:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:45:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770469024000000
2013-08-13 07:45:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-08-13 07:45:13 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:45:13 [DEBUG   ] Finished updating board flags in 1.666 seconds
2013-08-13 07:45:40 [INFO    ] __waitForTBW - TBW finished in 218.702 s
2013-08-13 07:45:41 [INFO    ] Started antennas statistics background thread
2013-08-13 07:45:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376379942']
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376379942']
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376379942']
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376379942']
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376379942']
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376379942']
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376379942']
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376379942']
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376379942']
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376379942']
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376379942']
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376379942']
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376379942']
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376379942']
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376379942']
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376379942']
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376379942']
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376379942']
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376379942']
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376379942']
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376379942']
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376379942']
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376379942']
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376379942']
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376379942']
2013-08-13 07:45:41 [DEBUG   ] spawn_process: at 2013-08-13 07:45:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376379942']
2013-08-13 07:45:41 [INFO    ] Finished spawning TBN in 0.053 s
2013-08-13 07:45:41 [DEBUG   ] Finished updating ant stats in 1.131 seconds
2013-08-13 07:46:01 [DEBUG   ] Finished updating ant stats in 0.985 seconds
2013-08-13 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:46:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770480588000000
2013-08-13 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:46:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770480588000000
2013-08-13 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:46:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770480784000000
2013-08-13 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:46:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770480784000000
2013-08-13 07:46:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 07:46:13 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:46:13 [DEBUG   ] Finished updating board flags in 1.812 seconds
2013-08-13 07:46:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 07:46:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 07:47:01 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:47:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770492348000000
2013-08-13 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:47:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770492348000000
2013-08-13 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:47:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770492544000000
2013-08-13 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:47:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770492544000000
2013-08-13 07:47:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 07:47:13 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:47:13 [DEBUG   ] Finished updating board flags in 1.665 seconds
2013-08-13 07:47:22 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-08-13 07:47:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 07:47:58 [DEBUG   ] Got command TBW from MCS: ref #19162
2013-08-13 07:47:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 07:47:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19162   8 56517 28078007 A  ERROR'
2013-08-13 07:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 07:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 07:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 07:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 07:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 07:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 07:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 07:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 07:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 07:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 07:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 07:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 07:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 07:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 07:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 07:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 07:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 07:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 07:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 07:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 07:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 07:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 07:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 07:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 07:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 07:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 07:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 07:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 07:48:01 [DEBUG   ] spawn_process: at 2013-08-13 07:48:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 07:48:01 [INFO    ] Finished spawning TBW
2013-08-13 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:48:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770504108000000
2013-08-13 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:48:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770504108000000
2013-08-13 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:48:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770504304000000
2013-08-13 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:48:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770504304000000
2013-08-13 07:48:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 07:48:13 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:48:13 [DEBUG   ] Finished updating board flags in 1.421 seconds
2013-08-13 07:49:01 [DEBUG   ] Got command RPT from MCS: ref #19164
2013-08-13 07:49:01 [DEBUG   ] summary = ERROR
2013-08-13 07:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19164  13 56517 28141367 A  ERRORERROR'
2013-08-13 07:49:01 [DEBUG   ] Got command RPT from MCS: ref #19165
2013-08-13 07:49:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 07:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19165  79 56517 28141367 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 07:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:49:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770515868000000
2013-08-13 07:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:49:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:49:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770515868000000
2013-08-13 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:49:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770516064000000
2013-08-13 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:49:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770516064000000
2013-08-13 07:49:13 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:49:13 [DEBUG   ] Finished updating board flags in 1.508 seconds
2013-08-13 07:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:50:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770527824000000
2013-08-13 07:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:50:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:50:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770527824000000
2013-08-13 07:50:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:50:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770527824000000
2013-08-13 07:50:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:50:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:50:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:50:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:50:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770527824000000
2013-08-13 07:50:13 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:50:13 [DEBUG   ] Finished updating board flags in 1.413 seconds
2013-08-13 07:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:51:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770539584000000
2013-08-13 07:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:51:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:51:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770539584000000
2013-08-13 07:51:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:51:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770539584000000
2013-08-13 07:51:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:51:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:51:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:51:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:51:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770539584000000
2013-08-13 07:51:13 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:51:13 [DEBUG   ] Finished updating board flags in 1.275 seconds
2013-08-13 07:51:40 [INFO    ] __waitForTBW - TBW finished in 218.745 s
2013-08-13 07:51:41 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-08-13 07:51:41 [INFO    ] Started antennas statistics background thread
2013-08-13 07:51:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376380302']
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376380302']
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376380302']
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376380302']
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376380302']
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376380302']
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376380302']
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376380302']
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376380302']
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376380302']
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376380302']
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376380302']
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376380302']
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376380302']
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376380302']
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376380302']
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376380302']
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376380302']
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376380302']
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376380302']
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376380302']
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376380302']
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376380302']
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376380302']
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376380302']
2013-08-13 07:51:41 [DEBUG   ] spawn_process: at 2013-08-13 07:51:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376380302']
2013-08-13 07:51:41 [INFO    ] Finished spawning TBN in 0.049 s
2013-08-13 07:52:01 [DEBUG   ] Finished updating ant stats in 0.873 seconds
2013-08-13 07:52:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:52:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770551344000000
2013-08-13 07:52:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:52:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:52:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:52:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:52:12 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770551344000000
2013-08-13 07:52:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:52:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770551344000000
2013-08-13 07:52:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:52:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:52:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:52:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:52:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770551344000000
2013-08-13 07:52:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 07:52:13 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:52:13 [DEBUG   ] Finished updating board flags in 1.515 seconds
2013-08-13 07:52:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 07:52:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 07:53:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-13 07:53:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:53:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770563104000000
2013-08-13 07:53:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:53:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:53:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:53:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:53:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770563104000000
2013-08-13 07:53:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:53:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770563300000000
2013-08-13 07:53:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:53:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:53:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:53:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:53:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770563300000000
2013-08-13 07:53:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 07:53:14 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:53:14 [DEBUG   ] Finished updating board flags in 2.293 seconds
2013-08-13 07:53:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-13 07:53:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-13 07:53:58 [DEBUG   ] Got command TBW from MCS: ref #19182
2013-08-13 07:53:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 07:53:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19182   8 56517 28438015 A  ERROR'
2013-08-13 07:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 07:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 07:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 07:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 07:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 07:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 07:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 07:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 07:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 07:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 07:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 07:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 07:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 07:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 07:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 07:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 07:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 07:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 07:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 07:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 07:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 07:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 07:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 07:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 07:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 07:54:01 [DEBUG   ] Got command RPT from MCS: ref #19184
2013-08-13 07:54:01 [DEBUG   ] summary = ERROR
2013-08-13 07:54:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19184  13 56517 28441363 A  ERRORERROR'
2013-08-13 07:54:01 [DEBUG   ] Got command RPT from MCS: ref #19185
2013-08-13 07:54:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 07:54:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19185  79 56517 28441363 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 07:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 07:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 07:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 07:54:01 [DEBUG   ] spawn_process: at 2013-08-13 07:54:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 07:54:01 [INFO    ] Finished spawning TBW
2013-08-13 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:54:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770574864000000
2013-08-13 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:54:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770574864000000
2013-08-13 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:54:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770575060000000
2013-08-13 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:54:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770575060000000
2013-08-13 07:54:13 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:54:13 [DEBUG   ] Finished updating board flags in 1.458 seconds
2013-08-13 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:55:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770586624000000
2013-08-13 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:55:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770586624000000
2013-08-13 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:55:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770586820000000
2013-08-13 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:55:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770586820000000
2013-08-13 07:55:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 07:55:14 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:55:14 [DEBUG   ] Finished updating board flags in 2.059 seconds
2013-08-13 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:56:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770598384000000
2013-08-13 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:56:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770598384000000
2013-08-13 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:56:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770598580000000
2013-08-13 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:56:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770598580000000
2013-08-13 07:56:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 07:56:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-08-13 07:56:14 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:56:14 [DEBUG   ] Finished updating board flags in 1.878 seconds
2013-08-13 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:57:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770610144000000
2013-08-13 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:57:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770610144000000
2013-08-13 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:57:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770610340000000
2013-08-13 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:57:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770610340000000
2013-08-13 07:57:14 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:57:14 [DEBUG   ] Finished updating board flags in 1.933 seconds
2013-08-13 07:57:40 [INFO    ] __waitForTBW - TBW finished in 218.479 s
2013-08-13 07:57:41 [INFO    ] Started antennas statistics background thread
2013-08-13 07:57:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376380662']
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376380662']
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376380662']
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376380662']
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376380662']
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376380662']
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376380662']
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376380662']
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376380662']
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376380662']
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376380662']
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376380662']
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376380662']
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376380662']
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376380662']
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376380662']
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376380662']
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376380662']
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376380662']
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376380662']
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376380662']
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376380662']
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376380662']
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376380662']
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376380662']
2013-08-13 07:57:41 [DEBUG   ] spawn_process: at 2013-08-13 07:57:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376380662']
2013-08-13 07:57:41 [INFO    ] Finished spawning TBN in 0.051 s
2013-08-13 07:57:41 [DEBUG   ] Finished updating ant stats in 1.269 seconds
2013-08-13 07:58:01 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2013-08-13 07:58:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:58:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770621904000000
2013-08-13 07:58:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:58:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:58:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:58:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:58:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770621904000000
2013-08-13 07:58:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:58:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770622100000000
2013-08-13 07:58:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:58:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:58:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:58:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:58:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770622100000000
2013-08-13 07:58:14 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:58:14 [DEBUG   ] Finished updating board flags in 2.017 seconds
2013-08-13 07:58:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 07:58:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 07:59:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 07:59:01 [DEBUG   ] Got command RPT from MCS: ref #19201
2013-08-13 07:59:01 [DEBUG   ] summary = ERROR
2013-08-13 07:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19201  13 56517 28741371 A  ERRORERROR'
2013-08-13 07:59:01 [DEBUG   ] Got command RPT from MCS: ref #19202
2013-08-13 07:59:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 07:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19202  79 56517 28741371 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 07:59:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 07:59:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770633664000000
2013-08-13 07:59:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 07:59:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 07:59:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 07:59:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 07:59:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770633664000000
2013-08-13 07:59:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 07:59:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770633860000000
2013-08-13 07:59:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 07:59:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 07:59:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 07:59:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 07:59:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770633860000000
2013-08-13 07:59:14 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 07:59:14 [DEBUG   ] Finished updating board flags in 1.849 seconds
2013-08-13 07:59:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 07:59:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 07:59:58 [DEBUG   ] Got command TBW from MCS: ref #19219
2013-08-13 07:59:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 07:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19219   8 56517 28798007 A  ERROR'
2013-08-13 07:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 07:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 07:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 07:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 07:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 08:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 08:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 08:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 08:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 08:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 08:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 08:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 08:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 08:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 08:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 08:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 08:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 08:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 08:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 08:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 08:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 08:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 08:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 08:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 08:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 08:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 08:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 08:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 08:00:01 [DEBUG   ] spawn_process: at 2013-08-13 08:00:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 08:00:01 [INFO    ] Finished spawning TBW
2013-08-13 08:00:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 08:00:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770645424000000
2013-08-13 08:00:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 08:00:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 08:00:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 08:00:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 08:00:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770645424000000
2013-08-13 08:00:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 08:00:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770645620000000
2013-08-13 08:00:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 08:00:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 08:00:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 08:00:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 08:00:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770645620000000
2013-08-13 08:00:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-08-13 08:00:14 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 08:00:14 [DEBUG   ] Finished updating board flags in 1.628 seconds
2013-08-13 08:01:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 08:01:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770657184000000
2013-08-13 08:01:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 08:01:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 08:01:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 08:01:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 08:01:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770657184000000
2013-08-13 08:01:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 08:01:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770657380000000
2013-08-13 08:01:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 08:01:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 08:01:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 08:01:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 08:01:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770657380000000
2013-08-13 08:01:14 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 08:01:14 [DEBUG   ] Finished updating board flags in 1.703 seconds
2013-08-13 08:02:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 08:02:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770668944000000
2013-08-13 08:02:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 08:02:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 08:02:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 08:02:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 08:02:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770668944000000
2013-08-13 08:02:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 08:02:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770669140000000
2013-08-13 08:02:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 08:02:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 08:02:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 08:02:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 08:02:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770669140000000
2013-08-13 08:02:14 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 08:02:14 [DEBUG   ] Finished updating board flags in 1.614 seconds
2013-08-13 08:03:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 08:03:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770680704000000
2013-08-13 08:03:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 08:03:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 08:03:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 08:03:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 08:03:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770680704000000
2013-08-13 08:03:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 08:03:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770680900000000
2013-08-13 08:03:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 08:03:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 08:03:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 08:03:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 08:03:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770680900000000
2013-08-13 08:03:14 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 08:03:14 [DEBUG   ] Finished updating board flags in 1.474 seconds
2013-08-13 08:03:40 [INFO    ] __waitForTBW - TBW finished in 218.617 s
2013-08-13 08:03:41 [INFO    ] Started antennas statistics background thread
2013-08-13 08:03:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376381022']
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376381022']
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376381022']
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376381022']
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376381022']
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376381022']
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376381022']
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376381022']
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376381022']
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376381022']
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376381022']
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376381022']
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376381022']
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376381022']
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376381022']
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376381022']
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376381022']
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376381022']
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376381022']
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376381022']
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376381022']
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376381022']
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376381022']
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376381022']
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376381022']
2013-08-13 08:03:41 [DEBUG   ] spawn_process: at 2013-08-13 08:03:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376381022']
2013-08-13 08:03:41 [INFO    ] Finished spawning TBN in 0.052 s
2013-08-13 08:03:41 [DEBUG   ] Finished updating ant stats in 1.215 seconds
2013-08-13 08:04:01 [DEBUG   ] Finished updating ant stats in 1.186 seconds
2013-08-13 08:04:01 [DEBUG   ] Got command RPT from MCS: ref #19221
2013-08-13 08:04:01 [DEBUG   ] summary = ERROR
2013-08-13 08:04:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19221  13 56517 29041375 A  ERRORERROR'
2013-08-13 08:04:01 [DEBUG   ] Got command RPT from MCS: ref #19222
2013-08-13 08:04:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 08:04:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19222  79 56517 29041375 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 08:04:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 08:04:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770692464000000
2013-08-13 08:04:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 08:04:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 08:04:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 08:04:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 08:04:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770692464000000
2013-08-13 08:04:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 08:04:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770692660000000
2013-08-13 08:04:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 08:04:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 08:04:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 08:04:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 08:04:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770692660000000
2013-08-13 08:04:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 08:04:14 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 08:04:14 [DEBUG   ] Finished updating board flags in 1.614 seconds
2013-08-13 08:04:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 08:04:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 08:05:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 08:05:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 08:05:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770704224000000
2013-08-13 08:05:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 08:05:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 08:05:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 08:05:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 08:05:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770704224000000
2013-08-13 08:05:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-08-13 08:05:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 08:05:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770704420000000
2013-08-13 08:05:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 08:05:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 08:05:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 08:05:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 08:05:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770704420000000
2013-08-13 08:05:14 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 08:05:14 [DEBUG   ] Finished updating board flags in 1.591 seconds
2013-08-13 08:05:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 08:05:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 08:05:58 [DEBUG   ] Got command TBW from MCS: ref #19239
2013-08-13 08:05:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 08:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19239   8 56517 29158007 A  ERROR'
2013-08-13 08:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 08:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 08:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 08:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 08:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 08:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 08:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 08:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 08:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 08:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 08:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 08:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 08:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 08:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 08:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 08:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 08:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 08:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 08:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 08:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 08:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 08:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 08:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 08:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 08:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 08:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 08:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 08:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 08:06:01 [DEBUG   ] spawn_process: at 2013-08-13 08:06:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 08:06:01 [INFO    ] Finished spawning TBW
2013-08-13 08:06:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254881
2013-08-13 08:06:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770716180000000
2013-08-13 08:06:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206876
2013-08-13 08:06:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258865
2013-08-13 08:06:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164244014
2013-08-13 08:06:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257259
2013-08-13 08:06:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770716180000000
2013-08-13 08:06:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156807
2013-08-13 08:06:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770716180000000
2013-08-13 08:06:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123411
2013-08-13 08:06:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148230
2013-08-13 08:06:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157934
2013-08-13 08:06:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164162072
2013-08-13 08:06:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770716180000000
2013-08-13 08:06:14 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 08:06:14 [DEBUG   ] Finished updating board flags in 1.203 seconds
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254685
2013-08-13 08:07:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770727940000000
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206680
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258669
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164243818
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257063
2013-08-13 08:07:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770727940000000
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-08-13 08:07:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156611
2013-08-13 08:07:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770727940000000
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123215
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148034
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157738
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164161876
2013-08-13 08:07:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770727940000000
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-08-13 08:07:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 08:07:14 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 08:07:14 [DEBUG   ] Finished updating board flags in 1.332 seconds
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254685
2013-08-13 08:08:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770739700000000
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206680
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258669
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164243818
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257063
2013-08-13 08:08:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770739700000000
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-13 08:08:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156611
2013-08-13 08:08:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770739700000000
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123215
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148034
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157738
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164161876
2013-08-13 08:08:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770739700000000
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-13 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-13 08:08:14 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 08:08:14 [DEBUG   ] Finished updating board flags in 1.218 seconds
2013-08-13 08:09:01 [DEBUG   ] Got command RPT from MCS: ref #19241
2013-08-13 08:09:01 [DEBUG   ] summary = ERROR
2013-08-13 08:09:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19241  13 56517 29341367 A  ERRORERROR'
2013-08-13 08:09:01 [DEBUG   ] Got command RPT from MCS: ref #19242
2013-08-13 08:09:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 08:09:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19242  79 56517 29341367 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 08:09:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254685
2013-08-13 08:09:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770751460000000
2013-08-13 08:09:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206680
2013-08-13 08:09:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258669
2013-08-13 08:09:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164243818
2013-08-13 08:09:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164257063
2013-08-13 08:09:13 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770751460000000
2013-08-13 08:09:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156611
2013-08-13 08:09:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770751460000000
2013-08-13 08:09:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123215
2013-08-13 08:09:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164148034
2013-08-13 08:09:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157738
2013-08-13 08:09:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164161876
2013-08-13 08:09:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770751460000000
2013-08-13 08:09:14 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 08:09:14 [DEBUG   ] Finished updating board flags in 1.156 seconds
2013-08-13 08:09:40 [INFO    ] __waitForTBW - TBW finished in 218.509 s
2013-08-13 08:09:41 [INFO    ] Started antennas statistics background thread
2013-08-13 08:09:41 [INFO    ] Resuming TBN at 37.800 MHz after TBW acquisition
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '1', '1376381382']
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '2', '1376381382']
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '3', '1376381382']
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '4', '1376381382']
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '5', '1376381382']
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '6', '1376381382']
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '7', '1376381382']
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '8', '1376381382']
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '9', '1376381382']
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '10', '1376381382']
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '11', '1376381382']
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '12', '1376381382']
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '13', '1376381382']
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '14', '1376381382']
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '15', '1376381382']
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '16', '1376381382']
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '17', '1376381382']
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '18', '1376381382']
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '19', '1376381382']
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '20', '1376381382']
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '21', '1376381382']
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '22', '1376381382']
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '23', '1376381382']
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '24', '1376381382']
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '25', '1376381382']
2013-08-13 08:09:41 [DEBUG   ] spawn_process: at 2013-08-13 08:09:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37800000.0', '7', '18', '0', '26', '1376381382']
2013-08-13 08:09:41 [INFO    ] Finished spawning TBN in 0.050 s
2013-08-13 08:09:41 [DEBUG   ] Finished updating ant stats in 1.271 seconds
2013-08-13 08:10:01 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254489
2013-08-13 08:10:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770763220000000
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206504
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258493
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164243642
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164256887
2013-08-13 08:10:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770763220000000
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-08-13 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156435
2013-08-13 08:10:15 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770763416000000
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123019
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164147838
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157542
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164161680
2013-08-13 08:10:15 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770763416000000
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-08-13 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-08-13 08:10:15 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 08:10:15 [DEBUG   ] Finished updating board flags in 2.189 seconds
2013-08-13 08:10:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 08:10:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 08:11:01 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254489
2013-08-13 08:11:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770774980000000
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206484
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258473
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164243622
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164256867
2013-08-13 08:11:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770774980000000
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-13 08:11:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156415
2013-08-13 08:11:15 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770775176000000
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123019
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164147838
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157542
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164161680
2013-08-13 08:11:15 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770775176000000
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-13 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-13 08:11:15 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 08:11:15 [DEBUG   ] Finished updating board flags in 1.922 seconds
2013-08-13 08:11:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 08:11:41 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-13 08:11:58 [DEBUG   ] Got command TBW from MCS: ref #19259
2013-08-13 08:11:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 08:11:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19259   8 56517 29518015 A  ERROR'
2013-08-13 08:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 08:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 08:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 08:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 08:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 08:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 08:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 08:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 08:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 08:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 08:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 08:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 08:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 08:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 08:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 08:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 08:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 08:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 08:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 08:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 08:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 08:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 08:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 08:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 08:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 08:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 08:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 08:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 08:12:01 [DEBUG   ] spawn_process: at 2013-08-13 08:12:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 08:12:01 [INFO    ] Finished spawning TBW
2013-08-13 08:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254489
2013-08-13 08:12:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770786740000000
2013-08-13 08:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206484
2013-08-13 08:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258473
2013-08-13 08:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164243622
2013-08-13 08:12:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164256867
2013-08-13 08:12:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770786740000000
2013-08-13 08:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156415
2013-08-13 08:12:15 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770786936000000
2013-08-13 08:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123019
2013-08-13 08:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164147838
2013-08-13 08:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157542
2013-08-13 08:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164161680
2013-08-13 08:12:15 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770786936000000
2013-08-13 08:12:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 08:12:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 08:12:15 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 08:12:15 [DEBUG   ] Finished updating board flags in 1.601 seconds
2013-08-13 08:13:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254489
2013-08-13 08:13:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770798500000000
2013-08-13 08:13:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206484
2013-08-13 08:13:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258473
2013-08-13 08:13:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164243622
2013-08-13 08:13:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164256867
2013-08-13 08:13:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770798500000000
2013-08-13 08:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156415
2013-08-13 08:13:15 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770798696000000
2013-08-13 08:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123019
2013-08-13 08:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164147838
2013-08-13 08:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157542
2013-08-13 08:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164161680
2013-08-13 08:13:15 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770798696000000
2013-08-13 08:13:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-08-13 08:13:15 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 08:13:15 [DEBUG   ] Finished updating board flags in 1.719 seconds
2013-08-13 08:14:01 [DEBUG   ] Got command RPT from MCS: ref #19261
2013-08-13 08:14:01 [DEBUG   ] summary = ERROR
2013-08-13 08:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19261  13 56517 29641375 A  ERRORERROR'
2013-08-13 08:14:01 [DEBUG   ] Got command RPT from MCS: ref #19262
2013-08-13 08:14:01 [DEBUG   ] info = SUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1
2013-08-13 08:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19262  79 56517 29641375 A  ERRORSUMMARY! 0x0A! DRX time not updating correctly - beam(s) #4, #3, #2, #1'
2013-08-13 08:14:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 164254489
2013-08-13 08:14:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 1 with 269770810260000000
2013-08-13 08:14:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 164206484
2013-08-13 08:14:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 164258473
2013-08-13 08:14:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 164243622
2013-08-13 08:14:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 164256867
2013-08-13 08:14:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa16, chip 5 with 269770810260000000
2013-08-13 08:14:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 164156415
2013-08-13 08:14:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 1 with 269770810456000000
2013-08-13 08:14:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 164123019
2013-08-13 08:14:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 164147838
2013-08-13 08:14:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 164157542
2013-08-13 08:14:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 164161680
2013-08-13 08:14:14 [WARNING ] MonitorFlags: DRX time not updating on hostname lwa34, chip 5 with 269770810456000000
2013-08-13 08:14:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 08:14:14 [CRITICAL] DRX time not updating correctly on beam(s) #4, #3, #2, #1
2013-08-13 08:14:14 [DEBUG   ] Finished updating board flags in 0.940 seconds
2013-08-13 08:15:00 [DEBUG   ] Got command INI from MCS: ref #19278
2013-08-13 08:15:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2013-08-13 08:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    19278   8 56517 29700591 ABOOTING'
2013-08-13 08:15:20 [INFO    ] -------------------
2013-08-13 08:15:20 [INFO    ]  LWA board status
2013-08-13 08:15:20 [INFO    ] -------------------
2013-08-13 08:15:20 [INFO    ] DP 1: 2 lwa27
2013-08-13 08:15:20 [INFO    ] DP 1: 3 lwa24
2013-08-13 08:15:20 [INFO    ] DP 1: 4 lwa23
2013-08-13 08:15:20 [INFO    ] DP 1: 5 lwa18
2013-08-13 08:15:20 [INFO    ] DP 1: 6 lwa10
2013-08-13 08:15:20 [INFO    ] DP 1: 7 lwa32
2013-08-13 08:15:20 [INFO    ] DP 1: 8 lwa11
2013-08-13 08:15:20 [INFO    ] DP 1: 9 lwa30
2013-08-13 08:15:20 [INFO    ] DP 1: 10 lwa12
2013-08-13 08:15:20 [INFO    ] DP 1: 11 lwa8
2013-08-13 08:15:20 [INFO    ] DP 1: 12 lwa13
2013-08-13 08:15:20 [INFO    ] DP 1: 13 lwa26
2013-08-13 08:15:20 [INFO    ] DP 1: 14 lwa14
2013-08-13 08:15:20 [INFO    ] DP 1: 16 lwa22
2013-08-13 08:15:20 [INFO    ] DP 1: 17 lwa20
2013-08-13 08:15:20 [INFO    ] DP 1: 18 lwa1
2013-08-13 08:15:20 [INFO    ] DP 1: 19 lwa5
2013-08-13 08:15:20 [INFO    ] DP 1: 20 lwa25
2013-08-13 08:15:20 [INFO    ] DP 1: 21 lwa35
2013-08-13 08:15:20 [INFO    ] DP 1: 22 lwa19
2013-08-13 08:15:20 [INFO    ] DP 1: 23 lwa21
2013-08-13 08:15:20 [INFO    ] DP 1: 24 lwa6
2013-08-13 08:15:20 [INFO    ] DP 1: 25 lwa7
2013-08-13 08:15:20 [INFO    ] DP 1: 26 lwa33
2013-08-13 08:15:20 [INFO    ] DP 1: 27 lwa15
2013-08-13 08:15:20 [INFO    ] DP 1: 28 lwa28
2013-08-13 08:15:20 [INFO    ] DP 2: 1 lwa16
2013-08-13 08:15:20 [INFO    ] DP 2: 15 lwa34
2013-08-13 08:15:20 [INFO    ] Total of 28 boards
2013-08-13 08:15:20 [INFO    ] Total of 260 stands
2013-08-13 08:15:20 [INFO    ] -------------------
2013-08-13 08:15:20 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:21 [DEBUG   ] __waitForTBW - lwa27 tbw process terminated, errcode=143
2013-08-13 08:15:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:21 [DEBUG   ] __waitForTBW - lwa24 tbw process terminated, errcode=143
2013-08-13 08:15:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:21 [DEBUG   ] __waitForTBW - lwa23 tbw process terminated, errcode=143
2013-08-13 08:15:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:21 [DEBUG   ] __waitForTBW - lwa18 tbw process terminated, errcode=143
2013-08-13 08:15:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:22 [DEBUG   ] __waitForTBW - lwa10 tbw process terminated, errcode=143
2013-08-13 08:15:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:22 [DEBUG   ] __waitForTBW - lwa32 tbw process terminated, errcode=143
2013-08-13 08:15:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:22 [DEBUG   ] __waitForTBW - lwa11 tbw process terminated, errcode=143
2013-08-13 08:15:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:23 [DEBUG   ] __waitForTBW - lwa30 tbw process terminated, errcode=143
2013-08-13 08:15:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:23 [DEBUG   ] __waitForTBW - lwa12 tbw process terminated, errcode=143
2013-08-13 08:15:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:23 [DEBUG   ] __waitForTBW - lwa8 tbw process terminated, errcode=143
2013-08-13 08:15:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:23 [DEBUG   ] __waitForTBW - lwa13 tbw process terminated, errcode=143
2013-08-13 08:15:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:24 [DEBUG   ] __waitForTBW - lwa26 tbw process terminated, errcode=143
2013-08-13 08:15:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:24 [DEBUG   ] __waitForTBW - lwa14 tbw process terminated, errcode=143
2013-08-13 08:15:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:24 [DEBUG   ] __waitForTBW - lwa22 tbw process terminated, errcode=143
2013-08-13 08:15:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:25 [DEBUG   ] __waitForTBW - lwa20 tbw process terminated, errcode=143
2013-08-13 08:15:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:25 [DEBUG   ] __waitForTBW - lwa1 tbw process terminated, errcode=143
2013-08-13 08:15:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:25 [DEBUG   ] __waitForTBW - lwa5 tbw process terminated, errcode=143
2013-08-13 08:15:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:25 [DEBUG   ] __waitForTBW - lwa25 tbw process terminated, errcode=143
2013-08-13 08:15:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:26 [DEBUG   ] __waitForTBW - lwa35 tbw process terminated, errcode=143
2013-08-13 08:15:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:26 [DEBUG   ] __waitForTBW - lwa19 tbw process terminated, errcode=143
2013-08-13 08:15:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:26 [DEBUG   ] __waitForTBW - lwa21 tbw process terminated, errcode=143
2013-08-13 08:15:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:26 [DEBUG   ] __waitForTBW - lwa6 tbw process terminated, errcode=143
2013-08-13 08:15:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:27 [DEBUG   ] __waitForTBW - lwa7 tbw process terminated, errcode=143
2013-08-13 08:15:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:27 [DEBUG   ] __waitForTBW - lwa33 tbw process terminated, errcode=143
2013-08-13 08:15:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:27 [DEBUG   ] __waitForTBW - lwa15 tbw process terminated, errcode=143
2013-08-13 08:15:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2013-08-13 08:15:27 [DEBUG   ] __waitForTBW - lwa28 tbw process terminated, errcode=143
2013-08-13 08:15:27 [INFO    ] __waitForTBW - TBW finished in 206.464 s
2013-08-13 08:15:28 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2013-08-13 08:15:28 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2013-08-13 08:15:28 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2013-08-13 08:15:28 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2013-08-13 08:15:28 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2013-08-13 08:15:28 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2013-08-13 08:15:28 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2013-08-13 08:15:28 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2013-08-13 08:15:28 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2013-08-13 08:15:28 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2013-08-13 08:15:28 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2013-08-13 08:15:28 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2013-08-13 08:15:28 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2013-08-13 08:15:28 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2013-08-13 08:15:28 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2013-08-13 08:15:28 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2013-08-13 08:15:28 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2013-08-13 08:15:28 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2013-08-13 08:15:28 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2013-08-13 08:15:28 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2013-08-13 08:15:28 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2013-08-13 08:15:28 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2013-08-13 08:15:28 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2013-08-13 08:15:28 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2013-08-13 08:15:28 [WARNING ] AntennaStats: command returned 1; error: FPGAs not programmed

2013-08-13 08:15:28 [WARNING ] AntennaStats: no access to lwa28
2013-08-13 08:15:28 [WARNING ] AntennaStats: last command was /usr/local/bin/lwa28 /lwa/software/amplitude
2013-08-13 08:15:28 [WARNING ] AntennaStats: last command output as 
2013-08-13 08:15:28 [DEBUG   ] Finished updating ant stats in 0.129 seconds
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14467
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14468
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14469
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14470
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14471
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14472
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14473
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14474
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14475
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14476
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14477
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14478
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14479
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14480
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14481
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14482
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14483
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14484
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14485
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14486
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14487
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14488
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14489
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14490
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14491
2013-08-13 08:15:28 [DEBUG   ] 2013-08-13 08:15:28 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 14492
2013-08-13 08:15:28 [INFO    ] Started antennas statistics background thread
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14467 exited with status 0
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14468 exited with status 0
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14469 exited with status 0
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14470 exited with status 0
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14471 exited with status 0
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14472 exited with status 0
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14473 exited with status 0
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14474 exited with status 0
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14475 exited with status 0
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14476 exited with status 0
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14477 exited with status 0
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14478 exited with status 0
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14479 exited with status 0
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14480 exited with status 0
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14481 exited with status 0
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14482 exited with status 0
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14483 exited with status 0
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14484 exited with status 0
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14485 exited with status 0
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14486 exited with status 0
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14487 exited with status 0
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14488 exited with status 0
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14489 exited with status 0
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14490 exited with status 0
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14491 exited with status 0
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 14492 exited with status 0
2013-08-13 08:15:40 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] spawn_process: at 2013-08-13 08:15:40 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 14519
2013-08-13 08:15:40 [DEBUG   ] 2013-08-13 08:15:40 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 14520
2013-08-13 08:15:46 [DEBUG   ] 2013-08-13 08:15:46 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 14519 exited with status 0
2013-08-13 08:15:46 [DEBUG   ] 2013-08-13 08:15:46 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 14520 exited with status 0
2013-08-13 08:15:46 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2013-08-13 08:15:46 [DEBUG   ] spawn_process: at 2013-08-13 08:15:46 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2013-08-13 08:15:46 [DEBUG   ] spawn_process: at 2013-08-13 08:15:46 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2013-08-13 08:15:46 [INFO    ] Setting Beam 1 xbars
2013-08-13 08:15:46 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2013-08-13 08:15:46 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2013-08-13 08:15:46 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2013-08-13 08:15:46 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2013-08-13 08:15:46 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2013-08-13 08:15:46 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2013-08-13 08:15:46 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2013-08-13 08:15:46 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2013-08-13 08:15:46 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2013-08-13 08:15:47 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2013-08-13 08:15:47 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2013-08-13 08:15:47 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2013-08-13 08:15:47 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2013-08-13 08:15:47 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2013-08-13 08:15:47 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2013-08-13 08:15:47 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2013-08-13 08:15:47 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2013-08-13 08:15:47 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2013-08-13 08:15:48 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2013-08-13 08:15:48 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2013-08-13 08:15:48 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2013-08-13 08:15:48 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2013-08-13 08:15:48 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2013-08-13 08:15:48 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2013-08-13 08:15:48 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2013-08-13 08:15:48 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2013-08-13 08:15:48 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2013-08-13 08:15:49 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2013-08-13 08:15:49 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2013-08-13 08:15:49 [DEBUG   ] Finished updating ant stats in 1.298 seconds
2013-08-13 08:15:49 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2013-08-13 08:15:49 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2013-08-13 08:15:49 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2013-08-13 08:15:49 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2013-08-13 08:15:49 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2013-08-13 08:15:49 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2013-08-13 08:15:50 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2013-08-13 08:15:50 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2013-08-13 08:15:50 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2013-08-13 08:15:50 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2013-08-13 08:15:50 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2013-08-13 08:15:50 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2013-08-13 08:15:50 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2013-08-13 08:15:50 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2013-08-13 08:15:50 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2013-08-13 08:15:51 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2013-08-13 08:15:51 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2013-08-13 08:15:51 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2013-08-13 08:15:51 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2013-08-13 08:15:51 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2013-08-13 08:15:51 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2013-08-13 08:15:51 [INFO    ] Setting Beam 2 xbars
2013-08-13 08:15:51 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2013-08-13 08:15:51 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2013-08-13 08:15:51 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2013-08-13 08:15:52 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2013-08-13 08:15:52 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2013-08-13 08:15:52 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2013-08-13 08:15:52 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2013-08-13 08:15:52 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2013-08-13 08:15:52 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2013-08-13 08:15:52 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2013-08-13 08:15:52 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2013-08-13 08:15:52 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2013-08-13 08:15:52 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2013-08-13 08:15:53 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2013-08-13 08:15:53 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2013-08-13 08:15:53 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2013-08-13 08:15:53 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2013-08-13 08:15:53 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2013-08-13 08:15:53 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2013-08-13 08:15:53 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2013-08-13 08:15:53 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2013-08-13 08:15:53 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2013-08-13 08:15:54 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2013-08-13 08:15:54 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2013-08-13 08:15:54 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2013-08-13 08:15:54 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2013-08-13 08:15:54 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2013-08-13 08:15:54 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2013-08-13 08:15:54 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2013-08-13 08:15:54 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2013-08-13 08:15:54 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2013-08-13 08:15:55 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2013-08-13 08:15:55 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2013-08-13 08:15:55 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2013-08-13 08:15:55 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2013-08-13 08:15:55 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2013-08-13 08:15:55 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2013-08-13 08:15:55 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2013-08-13 08:15:55 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2013-08-13 08:15:55 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2013-08-13 08:15:56 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2013-08-13 08:15:56 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2013-08-13 08:15:56 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2013-08-13 08:15:56 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2013-08-13 08:15:56 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2013-08-13 08:15:56 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2013-08-13 08:15:56 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2013-08-13 08:15:56 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2013-08-13 08:15:56 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2013-08-13 08:15:56 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2013-08-13 08:15:57 [INFO    ] Setting Beam 3 xbars
2013-08-13 08:15:57 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2013-08-13 08:15:57 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2013-08-13 08:15:57 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2013-08-13 08:15:57 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2013-08-13 08:15:57 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2013-08-13 08:15:57 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2013-08-13 08:15:57 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2013-08-13 08:15:57 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2013-08-13 08:15:57 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2013-08-13 08:15:58 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2013-08-13 08:15:58 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2013-08-13 08:15:58 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2013-08-13 08:15:58 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2013-08-13 08:15:58 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2013-08-13 08:15:58 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2013-08-13 08:15:58 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2013-08-13 08:15:58 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2013-08-13 08:15:58 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2013-08-13 08:15:59 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2013-08-13 08:15:59 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2013-08-13 08:15:59 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2013-08-13 08:15:59 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2013-08-13 08:15:59 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2013-08-13 08:15:59 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2013-08-13 08:15:59 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2013-08-13 08:15:59 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2013-08-13 08:15:59 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2013-08-13 08:15:59 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2013-08-13 08:16:00 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2013-08-13 08:16:00 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2013-08-13 08:16:00 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2013-08-13 08:16:00 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2013-08-13 08:16:00 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2013-08-13 08:16:00 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2013-08-13 08:16:00 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2013-08-13 08:16:00 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2013-08-13 08:16:00 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2013-08-13 08:16:01 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2013-08-13 08:16:01 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2013-08-13 08:16:01 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2013-08-13 08:16:01 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2013-08-13 08:16:01 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2013-08-13 08:16:01 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2013-08-13 08:16:01 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2013-08-13 08:16:01 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2013-08-13 08:16:01 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2013-08-13 08:16:02 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2013-08-13 08:16:02 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2013-08-13 08:16:02 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2013-08-13 08:16:02 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2013-08-13 08:16:02 [INFO    ] Setting Beam 4 xbars
2013-08-13 08:16:02 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2013-08-13 08:16:02 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2013-08-13 08:16:02 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2013-08-13 08:16:02 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2013-08-13 08:16:02 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2013-08-13 08:16:03 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2013-08-13 08:16:03 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2013-08-13 08:16:03 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2013-08-13 08:16:03 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2013-08-13 08:16:03 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2013-08-13 08:16:03 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2013-08-13 08:16:03 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2013-08-13 08:16:03 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2013-08-13 08:16:03 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2013-08-13 08:16:04 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2013-08-13 08:16:04 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2013-08-13 08:16:04 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2013-08-13 08:16:04 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2013-08-13 08:16:04 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2013-08-13 08:16:04 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2013-08-13 08:16:04 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2013-08-13 08:16:04 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2013-08-13 08:16:04 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2013-08-13 08:16:05 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2013-08-13 08:16:05 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2013-08-13 08:16:05 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2013-08-13 08:16:05 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2013-08-13 08:16:05 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2013-08-13 08:16:05 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2013-08-13 08:16:05 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2013-08-13 08:16:05 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2013-08-13 08:16:05 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2013-08-13 08:16:06 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2013-08-13 08:16:06 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2013-08-13 08:16:06 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2013-08-13 08:16:06 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2013-08-13 08:16:06 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2013-08-13 08:16:06 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2013-08-13 08:16:06 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2013-08-13 08:16:06 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2013-08-13 08:16:06 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2013-08-13 08:16:06 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2013-08-13 08:16:07 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2013-08-13 08:16:07 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2013-08-13 08:16:07 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2013-08-13 08:16:07 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2013-08-13 08:16:07 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2013-08-13 08:16:07 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2013-08-13 08:16:07 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2013-08-13 08:16:07 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2013-08-13 08:16:07 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2013-08-13 08:16:08 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2013-08-13 08:16:08 [INFO    ] All xbars set
2013-08-13 08:16:08 [INFO    ] Setting adder chain routing for all beams
2013-08-13 08:16:09 [DEBUG   ] Finished updating ant stats in 1.103 seconds
2013-08-13 08:16:13 [INFO    ] Setting beam ids
2013-08-13 08:16:23 [INFO    ] Starting beam delay calibration
2013-08-13 08:16:29 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2013-08-13 08:16:35 [INFO    ] Beam 1 latency is 5723
2013-08-13 08:16:35 [INFO    ] Beam 2 latency is 5766
2013-08-13 08:16:35 [INFO    ] Beam 3 latency is 5735
2013-08-13 08:16:35 [INFO    ] Beam 4 latency is 5734
2013-08-13 08:16:35 [INFO    ] Stop calibration
2013-08-13 08:16:43 [INFO    ] Beam delay calibration successful
2013-08-13 08:16:43 [INFO    ] Calibration passed
2013-08-13 08:16:43 [DEBUG   ] spawn_process: at 2013-08-13 08:16:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2013-08-13 08:16:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2013-08-13 08:16:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2013-08-13 08:16:43 [DEBUG   ] spawn_process: at 2013-08-13 08:16:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2013-08-13 08:16:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2013-08-13 08:16:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2013-08-13 08:16:43 [DEBUG   ] spawn_process: at 2013-08-13 08:16:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2013-08-13 08:16:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2013-08-13 08:16:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2013-08-13 08:16:43 [DEBUG   ] spawn_process: at 2013-08-13 08:16:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2013-08-13 08:16:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2013-08-13 08:16:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2013-08-13 08:16:43 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2013-08-13 08:16:43 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 397 ms (1376381803.399 s) with PID 16158 and time 1376381804
2013-08-13 08:16:43 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2013-08-13 08:16:43 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 485 ms (1376381803.487 s) with PID 16161 and time 1376381804
2013-08-13 08:16:45 [DEBUG   ] Finished updating ant stats in 0.661 seconds
2013-08-13 08:16:45 [INFO    ] Started antennas statistics background thread
2013-08-13 08:16:45 [INFO    ] Started board flags background thread
2013-08-13 08:16:45 [INFO    ] Started BAM background thread
2013-08-13 08:16:45 [INFO    ] Finished the INI process (ref. #19278) in 105.117 s
2013-08-13 08:16:46 [DEBUG   ] Finished updating board flags in 1.287 seconds
2013-08-13 08:17:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 08:17:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 08:17:45 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-08-13 08:17:46 [DEBUG   ] Finished updating board flags in 1.224 seconds
2013-08-13 08:17:58 [DEBUG   ] Got command TBW from MCS: ref #19280
2013-08-13 08:17:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 08:17:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19280   8 56517 29878011 A NORMAL'
2013-08-13 08:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 08:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 08:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 08:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 08:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 08:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 08:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 08:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 08:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 08:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 08:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 08:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 08:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 08:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 08:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 08:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 08:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 08:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 08:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 08:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 08:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 08:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 08:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 08:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 08:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 08:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 08:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 08:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 08:18:00 [DEBUG   ] spawn_process: at 2013-08-13 08:18:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 08:18:00 [INFO    ] Finished spawning TBW
2013-08-13 08:18:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 08:18:47 [DEBUG   ] Finished updating board flags in 1.891 seconds
2013-08-13 08:19:01 [DEBUG   ] Got command RPT from MCS: ref #19282
2013-08-13 08:19:01 [DEBUG   ] summary = NORMAL
2013-08-13 08:19:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19282  14 56517 29941375 A NORMALNORMAL'
2013-08-13 08:19:01 [DEBUG   ] Got command RPT from MCS: ref #19283
2013-08-13 08:19:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 08:19:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19283  48 56517 29941375 A NORMALSystem calibrated and operating normally'
2013-08-13 08:19:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 08:19:46 [DEBUG   ] Finished updating board flags in 1.127 seconds
2013-08-13 08:20:00 [DEBUG   ] Got command RPT from MCS: ref #19300
2013-08-13 08:20:00 [DEBUG   ] summary = NORMAL
2013-08-13 08:20:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19300  14 56517 30000599 A NORMALNORMAL'
2013-08-13 08:20:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 08:20:47 [DEBUG   ] Finished updating board flags in 1.664 seconds
2013-08-13 08:21:39 [INFO    ] __waitForTBW - TBW finished in 218.872 s
2013-08-13 08:21:40 [INFO    ] Started antennas statistics background thread
2013-08-13 08:21:40 [DEBUG   ] Finished updating ant stats in 1.184 seconds
2013-08-13 08:21:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 08:21:46 [DEBUG   ] Finished updating board flags in 0.939 seconds
2013-08-13 08:22:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 08:22:00 [DEBUG   ] Got command TBN from MCS: ref #19337
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376382122']
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376382122']
2013-08-13 08:22:00 [DEBUG   ] tbn = exited with status True, code 0x00
2013-08-13 08:22:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN    19337   8 56517 30120691 A NORMAL'
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376382122']
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376382122']
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376382122']
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376382122']
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376382122']
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376382122']
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376382122']
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376382122']
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376382122']
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376382122']
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376382122']
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376382122']
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376382122']
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376382122']
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376382122']
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376382122']
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376382122']
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376382122']
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376382122']
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376382122']
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376382122']
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376382122']
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376382122']
2013-08-13 08:22:00 [DEBUG   ] spawn_process: at 2013-08-13 08:22:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376382122']
2013-08-13 08:22:00 [INFO    ] Finished spawning TBN in 0.047 s
2013-08-13 08:22:20 [DEBUG   ] Finished updating ant stats in 1.068 seconds
2013-08-13 08:22:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 08:22:47 [DEBUG   ] Finished updating board flags in 1.546 seconds
2013-08-13 08:23:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 08:23:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 08:23:40 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 08:23:47 [DEBUG   ] Finished updating board flags in 1.396 seconds
2013-08-13 08:23:58 [DEBUG   ] Got command TBW from MCS: ref #19339
2013-08-13 08:23:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 08:23:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19339   8 56517 30238007 A NORMAL'
2013-08-13 08:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 08:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 08:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 08:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 08:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 08:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 08:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 08:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 08:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 08:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 08:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 08:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 08:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 08:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 08:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 08:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 08:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 08:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 08:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 08:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 08:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 08:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 08:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 08:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 08:24:01 [DEBUG   ] Got command RPT from MCS: ref #19341
2013-08-13 08:24:01 [DEBUG   ] summary = NORMAL
2013-08-13 08:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19341  14 56517 30241375 A NORMALNORMAL'
2013-08-13 08:24:01 [DEBUG   ] Got command RPT from MCS: ref #19342
2013-08-13 08:24:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 08:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19342  48 56517 30241375 A NORMALSystem calibrated and operating normally'
2013-08-13 08:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 08:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 08:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 08:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 08:24:01 [DEBUG   ] spawn_process: at 2013-08-13 08:24:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 08:24:01 [INFO    ] Finished spawning TBW
2013-08-13 08:24:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 08:24:47 [DEBUG   ] Finished updating board flags in 1.014 seconds
2013-08-13 08:25:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 08:25:48 [DEBUG   ] Finished updating board flags in 2.125 seconds
2013-08-13 08:26:48 [DEBUG   ] Finished updating board flags in 1.868 seconds
2013-08-13 08:27:40 [INFO    ] __waitForTBW - TBW finished in 218.366 s
2013-08-13 08:27:41 [INFO    ] Started antennas statistics background thread
2013-08-13 08:27:41 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376382462']
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376382462']
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376382462']
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376382462']
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376382462']
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376382462']
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376382462']
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376382462']
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376382462']
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376382462']
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376382462']
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376382462']
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376382462']
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376382462']
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376382462']
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376382462']
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376382462']
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376382462']
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376382462']
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376382462']
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376382462']
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376382462']
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376382462']
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376382462']
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376382462']
2013-08-13 08:27:41 [DEBUG   ] spawn_process: at 2013-08-13 08:27:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376382462']
2013-08-13 08:27:41 [INFO    ] Finished spawning TBN in 0.051 s
2013-08-13 08:27:41 [DEBUG   ] Finished updating ant stats in 1.270 seconds
2013-08-13 08:27:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 08:27:48 [DEBUG   ] Finished updating board flags in 1.998 seconds
2013-08-13 08:28:01 [DEBUG   ] Finished updating ant stats in 1.224 seconds
2013-08-13 08:28:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-08-13 08:28:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 08:28:48 [DEBUG   ] Finished updating board flags in 1.809 seconds
2013-08-13 08:29:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 08:29:01 [DEBUG   ] Got command RPT from MCS: ref #19358
2013-08-13 08:29:01 [DEBUG   ] summary = NORMAL
2013-08-13 08:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19358  14 56517 30541371 A NORMALNORMAL'
2013-08-13 08:29:01 [DEBUG   ] Got command RPT from MCS: ref #19359
2013-08-13 08:29:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 08:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19359  48 56517 30541371 A NORMALSystem calibrated and operating normally'
2013-08-13 08:29:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 08:29:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 08:29:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 08:29:48 [DEBUG   ] Finished updating board flags in 1.900 seconds
2013-08-13 08:29:58 [DEBUG   ] Got command TBW from MCS: ref #19376
2013-08-13 08:29:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 08:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19376   8 56517 30598011 A NORMAL'
2013-08-13 08:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 08:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 08:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 08:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 08:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 08:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 08:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 08:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 08:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 08:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 08:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 08:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 08:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 08:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 08:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 08:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 08:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 08:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 08:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 08:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 08:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 08:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 08:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 08:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 08:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 08:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 08:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 08:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 08:30:01 [DEBUG   ] spawn_process: at 2013-08-13 08:30:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 08:30:01 [INFO    ] Finished spawning TBW
2013-08-13 08:30:48 [DEBUG   ] Finished updating board flags in 1.513 seconds
2013-08-13 08:31:48 [DEBUG   ] Finished updating board flags in 1.519 seconds
2013-08-13 08:32:48 [DEBUG   ] Finished updating board flags in 1.272 seconds
2013-08-13 08:33:40 [INFO    ] __waitForTBW - TBW finished in 218.875 s
2013-08-13 08:33:41 [DEBUG   ] Finished updating ant stats in 0.874 seconds
2013-08-13 08:33:41 [INFO    ] Started antennas statistics background thread
2013-08-13 08:33:41 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376382822']
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376382822']
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376382822']
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376382822']
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376382822']
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376382822']
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376382822']
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376382822']
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376382822']
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376382822']
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376382822']
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376382822']
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376382822']
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376382822']
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376382822']
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376382822']
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376382822']
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376382822']
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376382822']
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376382822']
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376382822']
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376382822']
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376382822']
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376382822']
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376382822']
2013-08-13 08:33:41 [DEBUG   ] spawn_process: at 2013-08-13 08:33:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376382822']
2013-08-13 08:33:41 [INFO    ] Finished spawning TBN in 0.048 s
2013-08-13 08:33:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 08:33:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 08:33:48 [DEBUG   ] Finished updating board flags in 1.508 seconds
2013-08-13 08:34:01 [DEBUG   ] Finished updating ant stats in 0.868 seconds
2013-08-13 08:34:01 [DEBUG   ] Got command RPT from MCS: ref #19378
2013-08-13 08:34:01 [DEBUG   ] summary = NORMAL
2013-08-13 08:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19378  14 56517 30841375 A NORMALNORMAL'
2013-08-13 08:34:01 [DEBUG   ] Got command RPT from MCS: ref #19379
2013-08-13 08:34:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 08:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19379  48 56517 30841375 A NORMALSystem calibrated and operating normally'
2013-08-13 08:34:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 08:34:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 08:34:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 08:34:48 [DEBUG   ] Finished updating board flags in 1.496 seconds
2013-08-13 08:35:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 08:35:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 08:35:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 08:35:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 08:35:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 08:35:49 [DEBUG   ] Finished updating board flags in 2.308 seconds
2013-08-13 08:35:58 [DEBUG   ] Got command TBW from MCS: ref #19396
2013-08-13 08:35:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 08:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19396   8 56517 30958007 A NORMAL'
2013-08-13 08:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 08:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 08:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 08:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 08:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 08:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 08:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 08:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 08:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 08:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 08:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 08:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 08:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 08:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 08:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 08:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 08:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 08:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 08:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 08:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 08:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 08:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 08:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 08:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 08:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 08:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 08:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 08:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 08:36:01 [DEBUG   ] spawn_process: at 2013-08-13 08:36:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 08:36:01 [INFO    ] Finished spawning TBW
2013-08-13 08:36:48 [DEBUG   ] Finished updating board flags in 1.377 seconds
2013-08-13 08:37:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 08:37:49 [DEBUG   ] Finished updating board flags in 1.841 seconds
2013-08-13 08:38:49 [DEBUG   ] Finished updating board flags in 1.672 seconds
2013-08-13 08:39:01 [DEBUG   ] Got command RPT from MCS: ref #19398
2013-08-13 08:39:01 [DEBUG   ] summary = NORMAL
2013-08-13 08:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19398  14 56517 31141383 A NORMALNORMAL'
2013-08-13 08:39:01 [DEBUG   ] Got command RPT from MCS: ref #19399
2013-08-13 08:39:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 08:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19399  48 56517 31141383 A NORMALSystem calibrated and operating normally'
2013-08-13 08:39:40 [INFO    ] __waitForTBW - TBW finished in 218.710 s
2013-08-13 08:39:41 [INFO    ] Started antennas statistics background thread
2013-08-13 08:39:41 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376383182']
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376383182']
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376383182']
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376383182']
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376383182']
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376383182']
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376383182']
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376383182']
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376383182']
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376383182']
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376383182']
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376383182']
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376383182']
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376383182']
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376383182']
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376383182']
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376383182']
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376383182']
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376383182']
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376383182']
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376383182']
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376383182']
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376383182']
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376383182']
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376383182']
2013-08-13 08:39:41 [DEBUG   ] spawn_process: at 2013-08-13 08:39:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376383182']
2013-08-13 08:39:41 [INFO    ] Finished spawning TBN in 0.053 s
2013-08-13 08:39:41 [DEBUG   ] Finished updating ant stats in 1.145 seconds
2013-08-13 08:39:49 [DEBUG   ] Finished updating board flags in 1.802 seconds
2013-08-13 08:40:01 [DEBUG   ] Finished updating ant stats in 0.987 seconds
2013-08-13 08:40:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 08:40:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 08:40:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 08:40:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-08-13 08:40:49 [DEBUG   ] Finished updating board flags in 1.798 seconds
2013-08-13 08:41:01 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 08:41:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 08:41:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 08:41:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-08-13 08:41:49 [DEBUG   ] Finished updating board flags in 1.710 seconds
2013-08-13 08:41:58 [DEBUG   ] Got command TBW from MCS: ref #19416
2013-08-13 08:41:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 08:41:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19416   8 56517 31318015 A NORMAL'
2013-08-13 08:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 08:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 08:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 08:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 08:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 08:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 08:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 08:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 08:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 08:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 08:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 08:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 08:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 08:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 08:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 08:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 08:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 08:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 08:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 08:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 08:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 08:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 08:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 08:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 08:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 08:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 08:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 08:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 08:42:01 [DEBUG   ] spawn_process: at 2013-08-13 08:42:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 08:42:01 [INFO    ] Finished spawning TBW
2013-08-13 08:42:49 [DEBUG   ] Finished updating board flags in 1.325 seconds
2013-08-13 08:43:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2013-08-13 08:43:49 [DEBUG   ] Finished updating board flags in 1.304 seconds
2013-08-13 08:44:01 [DEBUG   ] Got command RPT from MCS: ref #19418
2013-08-13 08:44:01 [DEBUG   ] summary = NORMAL
2013-08-13 08:44:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19418  14 56517 31441383 A NORMALNORMAL'
2013-08-13 08:44:01 [DEBUG   ] Got command RPT from MCS: ref #19419
2013-08-13 08:44:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 08:44:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19419  48 56517 31441383 A NORMALSystem calibrated and operating normally'
2013-08-13 08:44:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-08-13 08:44:49 [DEBUG   ] Finished updating board flags in 1.084 seconds
2013-08-13 08:45:40 [INFO    ] __waitForTBW - TBW finished in 218.706 s
2013-08-13 08:45:41 [INFO    ] Started antennas statistics background thread
2013-08-13 08:45:41 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376383542']
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376383542']
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376383542']
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376383542']
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376383542']
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376383542']
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376383542']
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376383542']
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376383542']
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376383542']
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376383542']
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376383542']
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376383542']
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376383542']
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376383542']
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376383542']
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376383542']
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376383542']
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376383542']
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376383542']
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376383542']
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376383542']
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376383542']
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376383542']
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376383542']
2013-08-13 08:45:41 [DEBUG   ] spawn_process: at 2013-08-13 08:45:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376383542']
2013-08-13 08:45:41 [INFO    ] Finished spawning TBN in 0.053 s
2013-08-13 08:45:41 [DEBUG   ] Finished updating ant stats in 1.132 seconds
2013-08-13 08:45:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 08:45:50 [DEBUG   ] Finished updating board flags in 2.206 seconds
2013-08-13 08:46:01 [DEBUG   ] Finished updating ant stats in 0.986 seconds
2013-08-13 08:46:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 08:46:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 08:46:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 08:46:50 [DEBUG   ] Finished updating board flags in 2.193 seconds
2013-08-13 08:47:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 08:47:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 08:47:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 08:47:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 08:47:50 [DEBUG   ] Finished updating board flags in 2.117 seconds
2013-08-13 08:47:58 [DEBUG   ] Got command TBW from MCS: ref #19436
2013-08-13 08:47:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 08:47:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19436   8 56517 31678007 A NORMAL'
2013-08-13 08:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 08:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 08:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 08:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 08:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 08:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 08:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 08:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 08:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 08:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 08:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 08:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 08:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 08:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 08:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 08:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 08:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 08:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 08:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 08:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 08:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 08:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 08:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 08:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 08:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 08:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 08:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 08:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 08:48:01 [DEBUG   ] spawn_process: at 2013-08-13 08:48:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 08:48:01 [INFO    ] Finished spawning TBW
2013-08-13 08:48:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 08:48:49 [DEBUG   ] Finished updating board flags in 1.155 seconds
2013-08-13 08:49:01 [DEBUG   ] Got command RPT from MCS: ref #19438
2013-08-13 08:49:01 [DEBUG   ] summary = NORMAL
2013-08-13 08:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19438  14 56517 31741383 A NORMALNORMAL'
2013-08-13 08:49:01 [DEBUG   ] Got command RPT from MCS: ref #19439
2013-08-13 08:49:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 08:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19439  48 56517 31741383 A NORMALSystem calibrated and operating normally'
2013-08-13 08:49:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 08:49:50 [DEBUG   ] Finished updating board flags in 1.653 seconds
2013-08-13 08:50:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 08:50:49 [DEBUG   ] Finished updating board flags in 0.933 seconds
2013-08-13 08:51:39 [INFO    ] __waitForTBW - TBW finished in 218.422 s
2013-08-13 08:51:40 [DEBUG   ] Finished updating ant stats in 0.344 seconds
2013-08-13 08:51:40 [INFO    ] Started antennas statistics background thread
2013-08-13 08:51:40 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376383902']
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376383902']
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376383902']
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376383902']
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376383902']
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376383902']
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376383902']
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376383902']
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376383902']
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376383902']
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376383902']
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376383902']
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376383902']
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376383902']
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376383902']
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376383902']
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376383902']
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376383902']
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376383902']
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376383902']
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376383902']
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376383902']
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376383902']
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376383902']
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376383902']
2013-08-13 08:51:40 [DEBUG   ] spawn_process: at 2013-08-13 08:51:40 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376383902']
2013-08-13 08:51:40 [INFO    ] Finished spawning TBN in 0.049 s
2013-08-13 08:51:50 [DEBUG   ] Finished updating board flags in 1.548 seconds
2013-08-13 08:52:01 [DEBUG   ] Finished updating ant stats in 1.271 seconds
2013-08-13 08:52:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-13 08:52:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-13 08:52:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 08:52:50 [DEBUG   ] Finished updating board flags in 1.401 seconds
2013-08-13 08:53:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-13 08:53:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 08:53:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-13 08:53:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 08:53:50 [DEBUG   ] Finished updating board flags in 1.563 seconds
2013-08-13 08:53:58 [DEBUG   ] Got command TBW from MCS: ref #19456
2013-08-13 08:53:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 08:53:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19456   8 56517 32038007 A NORMAL'
2013-08-13 08:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 08:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 08:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 08:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 08:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 08:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 08:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 08:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 08:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 08:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 08:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 08:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 08:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 08:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 08:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 08:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 08:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 08:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 08:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 08:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 08:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 08:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 08:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 08:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 08:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 08:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 08:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 08:54:01 [DEBUG   ] Got command RPT from MCS: ref #19458
2013-08-13 08:54:01 [DEBUG   ] summary = NORMAL
2013-08-13 08:54:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19458  14 56517 32041387 A NORMALNORMAL'
2013-08-13 08:54:01 [DEBUG   ] Got command RPT from MCS: ref #19459
2013-08-13 08:54:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 08:54:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19459  48 56517 32041387 A NORMALSystem calibrated and operating normally'
2013-08-13 08:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 08:54:01 [DEBUG   ] spawn_process: at 2013-08-13 08:54:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 08:54:01 [INFO    ] Finished spawning TBW
2013-08-13 08:54:50 [DEBUG   ] Finished updating board flags in 1.055 seconds
2013-08-13 08:55:51 [DEBUG   ] Finished updating board flags in 2.122 seconds
2013-08-13 08:56:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-08-13 08:56:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-08-13 08:56:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 08:56:50 [DEBUG   ] Finished updating board flags in 1.325 seconds
2013-08-13 08:57:40 [INFO    ] __waitForTBW - TBW finished in 218.593 s
2013-08-13 08:57:41 [INFO    ] Started antennas statistics background thread
2013-08-13 08:57:41 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376384262']
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376384262']
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376384262']
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376384262']
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376384262']
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376384262']
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376384262']
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376384262']
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376384262']
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376384262']
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376384262']
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376384262']
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376384262']
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376384262']
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376384262']
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376384262']
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376384262']
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376384262']
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376384262']
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376384262']
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376384262']
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376384262']
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376384262']
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376384262']
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376384262']
2013-08-13 08:57:41 [DEBUG   ] spawn_process: at 2013-08-13 08:57:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376384262']
2013-08-13 08:57:41 [INFO    ] Finished spawning TBN in 0.052 s
2013-08-13 08:57:41 [DEBUG   ] Finished updating ant stats in 1.247 seconds
2013-08-13 08:57:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 08:57:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 08:57:51 [DEBUG   ] Finished updating board flags in 1.972 seconds
2013-08-13 08:58:01 [DEBUG   ] Finished updating ant stats in 1.180 seconds
2013-08-13 08:58:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 08:58:41 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 08:58:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 08:58:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 08:58:51 [DEBUG   ] Finished updating board flags in 1.777 seconds
2013-08-13 08:59:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 08:59:01 [DEBUG   ] Got command RPT from MCS: ref #19475
2013-08-13 08:59:01 [DEBUG   ] summary = NORMAL
2013-08-13 08:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19475  14 56517 32341387 A NORMALNORMAL'
2013-08-13 08:59:01 [DEBUG   ] Got command RPT from MCS: ref #19476
2013-08-13 08:59:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 08:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19476  48 56517 32341387 A NORMALSystem calibrated and operating normally'
2013-08-13 08:59:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-08-13 08:59:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 08:59:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 08:59:51 [DEBUG   ] Finished updating board flags in 1.591 seconds
2013-08-13 08:59:58 [DEBUG   ] Got command TBW from MCS: ref #19493
2013-08-13 08:59:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 08:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19493   8 56517 32398011 A NORMAL'
2013-08-13 08:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 08:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 08:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 08:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 08:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 09:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 09:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 09:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 09:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 09:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 09:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 09:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 09:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 09:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 09:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 09:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 09:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 09:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 09:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 09:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 09:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 09:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 09:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 09:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 09:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 09:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 09:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 09:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 09:00:01 [DEBUG   ] spawn_process: at 2013-08-13 09:00:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 09:00:01 [INFO    ] Finished spawning TBW
2013-08-13 09:00:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-08-13 09:00:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 09:00:51 [DEBUG   ] Finished updating board flags in 1.332 seconds
2013-08-13 09:01:51 [DEBUG   ] Finished updating board flags in 1.083 seconds
2013-08-13 09:02:52 [DEBUG   ] Finished updating board flags in 2.117 seconds
2013-08-13 09:03:39 [INFO    ] __waitForTBW - TBW finished in 218.088 s
2013-08-13 09:03:40 [DEBUG   ] Finished updating ant stats in 0.678 seconds
2013-08-13 09:03:40 [INFO    ] Started antennas statistics background thread
2013-08-13 09:03:40 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376384622']
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376384622']
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376384622']
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376384622']
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376384622']
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376384622']
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376384622']
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376384622']
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376384622']
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376384622']
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376384622']
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376384622']
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376384622']
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376384622']
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376384622']
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376384622']
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376384622']
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376384622']
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376384622']
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376384622']
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376384622']
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376384622']
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376384622']
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376384622']
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376384622']
2013-08-13 09:03:40 [DEBUG   ] spawn_process: at 2013-08-13 09:03:40 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376384622']
2013-08-13 09:03:40 [INFO    ] Finished spawning TBN in 0.046 s
2013-08-13 09:03:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 09:03:52 [DEBUG   ] Finished updating board flags in 2.221 seconds
2013-08-13 09:04:00 [DEBUG   ] Finished updating ant stats in 0.670 seconds
2013-08-13 09:04:01 [DEBUG   ] Got command RPT from MCS: ref #19495
2013-08-13 09:04:01 [DEBUG   ] summary = NORMAL
2013-08-13 09:04:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19495  14 56517 32641391 A NORMALNORMAL'
2013-08-13 09:04:01 [DEBUG   ] Got command RPT from MCS: ref #19496
2013-08-13 09:04:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 09:04:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19496  48 56517 32641391 A NORMALSystem calibrated and operating normally'
2013-08-13 09:04:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 09:04:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 09:04:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-08-13 09:04:52 [DEBUG   ] Finished updating board flags in 2.073 seconds
2013-08-13 09:05:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 09:05:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 09:05:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 09:05:52 [DEBUG   ] Finished updating board flags in 1.993 seconds
2013-08-13 09:05:58 [DEBUG   ] Got command TBW from MCS: ref #19513
2013-08-13 09:05:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 09:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19513   8 56517 32758011 A NORMAL'
2013-08-13 09:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 09:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 09:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 09:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 09:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 09:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 09:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 09:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 09:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 09:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 09:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 09:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 09:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 09:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 09:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 09:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 09:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 09:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 09:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 09:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 09:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 09:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 09:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 09:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 09:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 09:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 09:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 09:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 09:06:01 [DEBUG   ] spawn_process: at 2013-08-13 09:06:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 09:06:01 [INFO    ] Finished spawning TBW
2013-08-13 09:06:52 [DEBUG   ] Finished updating board flags in 1.594 seconds
2013-08-13 09:07:52 [DEBUG   ] Finished updating board flags in 1.528 seconds
2013-08-13 09:08:52 [DEBUG   ] Finished updating board flags in 1.276 seconds
2013-08-13 09:09:01 [DEBUG   ] Got command RPT from MCS: ref #19515
2013-08-13 09:09:01 [DEBUG   ] summary = NORMAL
2013-08-13 09:09:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19515  14 56517 32941383 A NORMALNORMAL'
2013-08-13 09:09:01 [DEBUG   ] Got command RPT from MCS: ref #19516
2013-08-13 09:09:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 09:09:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19516  48 56517 32941383 A NORMALSystem calibrated and operating normally'
2013-08-13 09:09:40 [INFO    ] __waitForTBW - TBW finished in 218.418 s
2013-08-13 09:09:41 [INFO    ] Started antennas statistics background thread
2013-08-13 09:09:41 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376384982']
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376384982']
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376384982']
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376384982']
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376384982']
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376384982']
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376384982']
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376384982']
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376384982']
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376384982']
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376384982']
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376384982']
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376384982']
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376384982']
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376384982']
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376384982']
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376384982']
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376384982']
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376384982']
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376384982']
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376384982']
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376384982']
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376384982']
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376384982']
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376384982']
2013-08-13 09:09:41 [DEBUG   ] spawn_process: at 2013-08-13 09:09:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376384982']
2013-08-13 09:09:41 [INFO    ] Finished spawning TBN in 0.050 s
2013-08-13 09:09:41 [DEBUG   ] Finished updating ant stats in 1.256 seconds
2013-08-13 09:09:52 [DEBUG   ] Finished updating board flags in 1.546 seconds
2013-08-13 09:10:01 [DEBUG   ] Finished updating ant stats in 1.188 seconds
2013-08-13 09:10:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 09:10:41 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 09:10:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2013-08-13 09:10:52 [DEBUG   ] Finished updating board flags in 1.494 seconds
2013-08-13 09:11:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-13 09:11:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-08-13 09:11:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 09:11:53 [DEBUG   ] Finished updating board flags in 2.182 seconds
2013-08-13 09:11:58 [DEBUG   ] Got command TBW from MCS: ref #19533
2013-08-13 09:11:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 09:11:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19533   8 56517 33118011 A NORMAL'
2013-08-13 09:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 09:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 09:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 09:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 09:11:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 09:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 09:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 09:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 09:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 09:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 09:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 09:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 09:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 09:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 09:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 09:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 09:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 09:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 09:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 09:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 09:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 09:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 09:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 09:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 09:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 09:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 09:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 09:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 09:12:01 [DEBUG   ] spawn_process: at 2013-08-13 09:12:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 09:12:01 [INFO    ] Finished spawning TBW
2013-08-13 09:12:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 09:12:53 [DEBUG   ] Finished updating board flags in 1.366 seconds
2013-08-13 09:13:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 09:13:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 09:13:53 [DEBUG   ] Finished updating board flags in 1.752 seconds
2013-08-13 09:14:01 [DEBUG   ] Got command RPT from MCS: ref #19535
2013-08-13 09:14:01 [DEBUG   ] summary = NORMAL
2013-08-13 09:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19535  14 56517 33241395 A NORMALNORMAL'
2013-08-13 09:14:01 [DEBUG   ] Got command RPT from MCS: ref #19536
2013-08-13 09:14:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 09:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19536  48 56517 33241395 A NORMALSystem calibrated and operating normally'
2013-08-13 09:14:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 09:14:52 [DEBUG   ] Finished updating board flags in 0.945 seconds
2013-08-13 09:15:40 [INFO    ] __waitForTBW - TBW finished in 218.524 s
2013-08-13 09:15:41 [INFO    ] Started antennas statistics background thread
2013-08-13 09:15:41 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376385342']
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376385342']
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376385342']
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376385342']
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376385342']
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376385342']
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376385342']
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376385342']
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376385342']
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376385342']
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376385342']
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376385342']
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376385342']
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376385342']
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376385342']
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376385342']
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376385342']
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376385342']
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376385342']
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376385342']
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376385342']
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376385342']
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376385342']
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376385342']
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376385342']
2013-08-13 09:15:41 [DEBUG   ] spawn_process: at 2013-08-13 09:15:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376385342']
2013-08-13 09:15:41 [INFO    ] Finished spawning TBN in 0.050 s
2013-08-13 09:15:41 [DEBUG   ] Finished updating ant stats in 1.271 seconds
2013-08-13 09:15:53 [DEBUG   ] Finished updating board flags in 1.520 seconds
2013-08-13 09:16:01 [DEBUG   ] Finished updating ant stats in 1.238 seconds
2013-08-13 09:16:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 09:16:41 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2013-08-13 09:16:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 09:16:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 09:16:54 [DEBUG   ] Finished updating board flags in 2.406 seconds
2013-08-13 09:17:01 [DEBUG   ] Finished updating ant stats in 0.871 seconds
2013-08-13 09:17:21 [DEBUG   ] Finished updating ant stats in 0.732 seconds
2013-08-13 09:17:41 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-13 09:17:53 [DEBUG   ] Finished updating board flags in 1.391 seconds
2013-08-13 09:17:58 [DEBUG   ] Got command TBW from MCS: ref #19553
2013-08-13 09:17:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 09:17:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19553   8 56517 33478007 A NORMAL'
2013-08-13 09:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 09:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 09:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 09:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 09:17:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 09:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 09:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 09:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 09:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 09:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 09:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 09:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 09:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 09:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 09:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 09:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 09:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 09:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 09:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 09:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 09:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 09:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 09:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 09:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 09:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 09:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 09:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 09:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 09:18:01 [DEBUG   ] spawn_process: at 2013-08-13 09:18:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 09:18:01 [INFO    ] Finished spawning TBW
2013-08-13 09:18:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 09:18:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 09:18:53 [DEBUG   ] Finished updating board flags in 1.190 seconds
2013-08-13 09:19:01 [DEBUG   ] Got command RPT from MCS: ref #19555
2013-08-13 09:19:01 [DEBUG   ] summary = NORMAL
2013-08-13 09:19:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19555  14 56517 33541387 A NORMALNORMAL'
2013-08-13 09:19:01 [DEBUG   ] Got command RPT from MCS: ref #19556
2013-08-13 09:19:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 09:19:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19556  48 56517 33541387 A NORMALSystem calibrated and operating normally'
2013-08-13 09:19:54 [DEBUG   ] Finished updating board flags in 1.949 seconds
2013-08-13 09:20:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 09:20:54 [DEBUG   ] Finished updating board flags in 1.814 seconds
2013-08-13 09:21:39 [INFO    ] __waitForTBW - TBW finished in 218.465 s
2013-08-13 09:21:40 [INFO    ] Started antennas statistics background thread
2013-08-13 09:21:40 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 09:21:40 [DEBUG   ] spawn_process: at 2013-08-13 09:21:40 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376385702']
2013-08-13 09:21:40 [DEBUG   ] spawn_process: at 2013-08-13 09:21:40 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376385702']
2013-08-13 09:21:40 [DEBUG   ] spawn_process: at 2013-08-13 09:21:40 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376385702']
2013-08-13 09:21:40 [DEBUG   ] spawn_process: at 2013-08-13 09:21:40 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376385702']
2013-08-13 09:21:40 [DEBUG   ] spawn_process: at 2013-08-13 09:21:40 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376385702']
2013-08-13 09:21:40 [DEBUG   ] spawn_process: at 2013-08-13 09:21:40 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376385702']
2013-08-13 09:21:40 [DEBUG   ] spawn_process: at 2013-08-13 09:21:40 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376385702']
2013-08-13 09:21:40 [DEBUG   ] spawn_process: at 2013-08-13 09:21:40 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376385702']
2013-08-13 09:21:41 [DEBUG   ] spawn_process: at 2013-08-13 09:21:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376385702']
2013-08-13 09:21:41 [DEBUG   ] spawn_process: at 2013-08-13 09:21:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376385702']
2013-08-13 09:21:41 [DEBUG   ] spawn_process: at 2013-08-13 09:21:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376385702']
2013-08-13 09:21:41 [DEBUG   ] spawn_process: at 2013-08-13 09:21:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376385702']
2013-08-13 09:21:41 [DEBUG   ] spawn_process: at 2013-08-13 09:21:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376385702']
2013-08-13 09:21:41 [DEBUG   ] spawn_process: at 2013-08-13 09:21:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376385702']
2013-08-13 09:21:41 [DEBUG   ] spawn_process: at 2013-08-13 09:21:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376385702']
2013-08-13 09:21:41 [DEBUG   ] spawn_process: at 2013-08-13 09:21:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376385702']
2013-08-13 09:21:41 [DEBUG   ] spawn_process: at 2013-08-13 09:21:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376385702']
2013-08-13 09:21:41 [DEBUG   ] spawn_process: at 2013-08-13 09:21:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376385702']
2013-08-13 09:21:41 [DEBUG   ] spawn_process: at 2013-08-13 09:21:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376385702']
2013-08-13 09:21:41 [DEBUG   ] spawn_process: at 2013-08-13 09:21:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376385702']
2013-08-13 09:21:41 [DEBUG   ] spawn_process: at 2013-08-13 09:21:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376385702']
2013-08-13 09:21:41 [DEBUG   ] spawn_process: at 2013-08-13 09:21:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376385702']
2013-08-13 09:21:41 [DEBUG   ] spawn_process: at 2013-08-13 09:21:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376385702']
2013-08-13 09:21:41 [DEBUG   ] spawn_process: at 2013-08-13 09:21:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376385702']
2013-08-13 09:21:41 [DEBUG   ] spawn_process: at 2013-08-13 09:21:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376385702']
2013-08-13 09:21:41 [DEBUG   ] spawn_process: at 2013-08-13 09:21:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376385702']
2013-08-13 09:21:41 [INFO    ] Finished spawning TBN in 0.051 s
2013-08-13 09:21:41 [DEBUG   ] Finished updating ant stats in 1.270 seconds
2013-08-13 09:21:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 09:21:54 [DEBUG   ] Finished updating board flags in 2.012 seconds
2013-08-13 09:22:01 [DEBUG   ] Finished updating ant stats in 1.270 seconds
2013-08-13 09:22:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 09:22:41 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 09:22:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 09:22:54 [DEBUG   ] Finished updating board flags in 1.867 seconds
2013-08-13 09:23:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-13 09:23:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 09:23:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 09:23:54 [DEBUG   ] Finished updating board flags in 1.793 seconds
2013-08-13 09:23:58 [DEBUG   ] Got command TBW from MCS: ref #19573
2013-08-13 09:23:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 09:23:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19573   8 56517 33838015 A NORMAL'
2013-08-13 09:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 09:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 09:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 09:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 09:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 09:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 09:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 09:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 09:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 09:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 09:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 09:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 09:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 09:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 09:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 09:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 09:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 09:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 09:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 09:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 09:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 09:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 09:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 09:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 09:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 09:24:01 [DEBUG   ] Got command RPT from MCS: ref #19575
2013-08-13 09:24:01 [DEBUG   ] summary = NORMAL
2013-08-13 09:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19575  14 56517 33841395 A NORMALNORMAL'
2013-08-13 09:24:01 [DEBUG   ] Got command RPT from MCS: ref #19576
2013-08-13 09:24:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 09:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19576  48 56517 33841395 A NORMALSystem calibrated and operating normally'
2013-08-13 09:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 09:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 09:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 09:24:01 [DEBUG   ] spawn_process: at 2013-08-13 09:24:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 09:24:01 [INFO    ] Finished spawning TBW
2013-08-13 09:24:54 [DEBUG   ] Finished updating board flags in 1.400 seconds
2013-08-13 09:25:54 [DEBUG   ] Finished updating board flags in 1.531 seconds
2013-08-13 09:26:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 09:26:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 09:26:54 [DEBUG   ] Finished updating board flags in 1.274 seconds
2013-08-13 09:27:40 [INFO    ] __waitForTBW - TBW finished in 218.395 s
2013-08-13 09:27:41 [INFO    ] Started antennas statistics background thread
2013-08-13 09:27:41 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376386062']
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376386062']
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376386062']
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376386062']
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376386062']
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376386062']
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376386062']
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376386062']
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376386062']
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376386062']
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376386062']
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376386062']
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376386062']
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376386062']
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376386062']
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376386062']
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376386062']
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376386062']
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376386062']
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376386062']
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376386062']
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376386062']
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376386062']
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376386062']
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376386062']
2013-08-13 09:27:41 [DEBUG   ] spawn_process: at 2013-08-13 09:27:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376386062']
2013-08-13 09:27:41 [INFO    ] Finished spawning TBN in 0.053 s
2013-08-13 09:27:41 [DEBUG   ] Finished updating ant stats in 1.274 seconds
2013-08-13 09:27:54 [DEBUG   ] Finished updating board flags in 1.496 seconds
2013-08-13 09:28:01 [DEBUG   ] Finished updating ant stats in 1.242 seconds
2013-08-13 09:28:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 09:28:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 09:28:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 09:28:54 [DEBUG   ] Finished updating board flags in 1.499 seconds
2013-08-13 09:29:01 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 09:29:01 [DEBUG   ] Got command RPT from MCS: ref #19592
2013-08-13 09:29:01 [DEBUG   ] summary = NORMAL
2013-08-13 09:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19592  14 56517 34141395 A NORMALNORMAL'
2013-08-13 09:29:01 [DEBUG   ] Got command RPT from MCS: ref #19593
2013-08-13 09:29:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 09:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19593  48 56517 34141395 A NORMALSystem calibrated and operating normally'
2013-08-13 09:29:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 09:29:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 09:29:54 [DEBUG   ] Finished updating board flags in 1.492 seconds
2013-08-13 09:29:58 [DEBUG   ] Got command TBW from MCS: ref #19610
2013-08-13 09:29:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 09:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19610   8 56517 34198007 A NORMAL'
2013-08-13 09:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 09:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 09:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 09:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 09:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 09:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 09:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 09:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 09:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 09:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 09:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 09:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 09:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 09:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 09:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 09:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 09:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 09:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 09:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 09:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 09:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 09:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 09:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 09:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 09:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 09:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 09:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 09:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 09:30:01 [DEBUG   ] spawn_process: at 2013-08-13 09:30:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 09:30:01 [INFO    ] Finished spawning TBW
2013-08-13 09:30:55 [DEBUG   ] Finished updating board flags in 2.054 seconds
2013-08-13 09:31:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 09:31:54 [DEBUG   ] Finished updating board flags in 1.342 seconds
2013-08-13 09:32:55 [DEBUG   ] Finished updating board flags in 1.851 seconds
2013-08-13 09:33:39 [INFO    ] __waitForTBW - TBW finished in 218.390 s
2013-08-13 09:33:40 [DEBUG   ] Finished updating ant stats in 0.385 seconds
2013-08-13 09:33:40 [INFO    ] Started antennas statistics background thread
2013-08-13 09:33:40 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376386422']
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376386422']
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376386422']
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376386422']
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376386422']
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376386422']
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376386422']
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376386422']
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376386422']
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376386422']
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376386422']
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376386422']
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376386422']
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376386422']
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376386422']
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376386422']
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376386422']
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376386422']
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376386422']
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376386422']
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376386422']
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376386422']
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376386422']
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376386422']
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376386422']
2013-08-13 09:33:40 [DEBUG   ] spawn_process: at 2013-08-13 09:33:40 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376386422']
2013-08-13 09:33:40 [INFO    ] Finished spawning TBN in 0.048 s
2013-08-13 09:33:55 [DEBUG   ] Finished updating board flags in 2.024 seconds
2013-08-13 09:34:01 [DEBUG   ] Finished updating ant stats in 1.273 seconds
2013-08-13 09:34:01 [DEBUG   ] Got command RPT from MCS: ref #19612
2013-08-13 09:34:01 [DEBUG   ] summary = NORMAL
2013-08-13 09:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19612  14 56517 34441391 A NORMALNORMAL'
2013-08-13 09:34:01 [DEBUG   ] Got command RPT from MCS: ref #19613
2013-08-13 09:34:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 09:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19613  48 56517 34441391 A NORMALSystem calibrated and operating normally'
2013-08-13 09:34:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 09:34:41 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 09:34:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 09:34:55 [DEBUG   ] Finished updating board flags in 1.920 seconds
2013-08-13 09:35:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 09:35:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 09:35:41 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-13 09:35:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 09:35:55 [DEBUG   ] Finished updating board flags in 1.739 seconds
2013-08-13 09:35:58 [DEBUG   ] Got command TBW from MCS: ref #19630
2013-08-13 09:35:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 09:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19630   8 56517 34558015 A NORMAL'
2013-08-13 09:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 09:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 09:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 09:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 09:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 09:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 09:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 09:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 09:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 09:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 09:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 09:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 09:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 09:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 09:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 09:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 09:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 09:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 09:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 09:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 09:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 09:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 09:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 09:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 09:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 09:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 09:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 09:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 09:36:01 [DEBUG   ] spawn_process: at 2013-08-13 09:36:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 09:36:01 [INFO    ] Finished spawning TBW
2013-08-13 09:36:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 09:36:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 09:36:55 [DEBUG   ] Finished updating board flags in 1.417 seconds
2013-08-13 09:37:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2013-08-13 09:37:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 09:37:55 [DEBUG   ] Finished updating board flags in 1.515 seconds
2013-08-13 09:38:55 [DEBUG   ] Finished updating board flags in 1.273 seconds
2013-08-13 09:39:01 [DEBUG   ] Got command RPT from MCS: ref #19632
2013-08-13 09:39:01 [DEBUG   ] summary = NORMAL
2013-08-13 09:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19632  14 56517 34741399 A NORMALNORMAL'
2013-08-13 09:39:01 [DEBUG   ] Got command RPT from MCS: ref #19633
2013-08-13 09:39:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 09:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19633  48 56517 34741400 A NORMALSystem calibrated and operating normally'
2013-08-13 09:39:40 [INFO    ] __waitForTBW - TBW finished in 218.590 s
2013-08-13 09:39:41 [INFO    ] Started antennas statistics background thread
2013-08-13 09:39:41 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376386782']
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376386782']
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376386782']
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376386782']
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376386782']
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376386782']
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376386782']
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376386782']
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376386782']
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376386782']
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376386782']
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376386782']
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376386782']
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376386782']
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376386782']
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376386782']
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376386782']
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376386782']
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376386782']
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376386782']
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376386782']
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376386782']
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376386782']
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376386782']
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376386782']
2013-08-13 09:39:41 [DEBUG   ] spawn_process: at 2013-08-13 09:39:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376386782']
2013-08-13 09:39:41 [INFO    ] Finished spawning TBN in 0.054 s
2013-08-13 09:39:41 [DEBUG   ] Finished updating ant stats in 1.081 seconds
2013-08-13 09:39:55 [DEBUG   ] Finished updating board flags in 1.489 seconds
2013-08-13 09:40:01 [DEBUG   ] Finished updating ant stats in 1.033 seconds
2013-08-13 09:40:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 09:40:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 09:40:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 09:40:55 [DEBUG   ] Finished updating board flags in 1.505 seconds
2013-08-13 09:41:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-13 09:41:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-08-13 09:41:41 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-13 09:41:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 09:41:55 [DEBUG   ] Finished updating board flags in 1.500 seconds
2013-08-13 09:41:58 [DEBUG   ] Got command TBW from MCS: ref #19650
2013-08-13 09:41:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 09:41:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19650   8 56517 34918007 A NORMAL'
2013-08-13 09:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 09:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 09:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 09:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 09:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 09:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 09:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 09:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 09:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 09:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 09:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 09:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 09:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 09:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 09:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 09:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 09:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 09:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 09:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 09:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 09:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 09:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 09:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 09:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 09:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 09:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 09:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 09:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 09:42:01 [DEBUG   ] spawn_process: at 2013-08-13 09:42:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 09:42:01 [INFO    ] Finished spawning TBW
2013-08-13 09:42:56 [DEBUG   ] Finished updating board flags in 2.052 seconds
2013-08-13 09:43:56 [DEBUG   ] Finished updating board flags in 1.867 seconds
2013-08-13 09:44:01 [DEBUG   ] Got command RPT from MCS: ref #19652
2013-08-13 09:44:01 [DEBUG   ] summary = NORMAL
2013-08-13 09:44:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19652  14 56517 35041403 A NORMALNORMAL'
2013-08-13 09:44:01 [DEBUG   ] Got command RPT from MCS: ref #19653
2013-08-13 09:44:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 09:44:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19653  48 56517 35041403 A NORMALSystem calibrated and operating normally'
2013-08-13 09:44:56 [DEBUG   ] Finished updating board flags in 1.935 seconds
2013-08-13 09:45:39 [INFO    ] __waitForTBW - TBW finished in 218.522 s
2013-08-13 09:45:41 [INFO    ] Started antennas statistics background thread
2013-08-13 09:45:41 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376387142']
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376387142']
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376387142']
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376387142']
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376387142']
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376387142']
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376387142']
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376387142']
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376387142']
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376387142']
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376387142']
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376387142']
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376387142']
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376387142']
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376387142']
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376387142']
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376387142']
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376387142']
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376387142']
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376387142']
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376387142']
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376387142']
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376387142']
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376387142']
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376387142']
2013-08-13 09:45:41 [DEBUG   ] spawn_process: at 2013-08-13 09:45:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376387142']
2013-08-13 09:45:41 [INFO    ] Finished spawning TBN in 0.052 s
2013-08-13 09:45:41 [DEBUG   ] Finished updating ant stats in 1.273 seconds
2013-08-13 09:45:56 [DEBUG   ] Finished updating board flags in 2.014 seconds
2013-08-13 09:46:01 [DEBUG   ] Finished updating ant stats in 1.249 seconds
2013-08-13 09:46:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 09:46:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 09:46:56 [DEBUG   ] Finished updating board flags in 1.843 seconds
2013-08-13 09:47:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-13 09:47:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 09:47:41 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-13 09:47:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 09:47:56 [DEBUG   ] Finished updating board flags in 1.813 seconds
2013-08-13 09:47:58 [DEBUG   ] Got command TBW from MCS: ref #19670
2013-08-13 09:47:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 09:47:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19670   8 56517 35278015 A NORMAL'
2013-08-13 09:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 09:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 09:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 09:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 09:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 09:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 09:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 09:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 09:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 09:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 09:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 09:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 09:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 09:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 09:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 09:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 09:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 09:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 09:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 09:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 09:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 09:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 09:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 09:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 09:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 09:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 09:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 09:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 09:48:01 [DEBUG   ] spawn_process: at 2013-08-13 09:48:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 09:48:01 [INFO    ] Finished spawning TBW
2013-08-13 09:48:56 [DEBUG   ] Finished updating board flags in 1.593 seconds
2013-08-13 09:49:01 [DEBUG   ] Got command RPT from MCS: ref #19672
2013-08-13 09:49:01 [DEBUG   ] summary = NORMAL
2013-08-13 09:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19672  14 56517 35341399 A NORMALNORMAL'
2013-08-13 09:49:01 [DEBUG   ] Got command RPT from MCS: ref #19673
2013-08-13 09:49:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 09:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19673  48 56517 35341399 A NORMALSystem calibrated and operating normally'
2013-08-13 09:49:56 [DEBUG   ] Finished updating board flags in 1.530 seconds
2013-08-13 09:50:56 [DEBUG   ] Finished updating board flags in 1.301 seconds
2013-08-13 09:51:39 [INFO    ] __waitForTBW - TBW finished in 218.271 s
2013-08-13 09:51:40 [DEBUG   ] Finished updating ant stats in 0.360 seconds
2013-08-13 09:51:40 [INFO    ] Started antennas statistics background thread
2013-08-13 09:51:40 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376387502']
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376387502']
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376387502']
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376387502']
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376387502']
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376387502']
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376387502']
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376387502']
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376387502']
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376387502']
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376387502']
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376387502']
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376387502']
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376387502']
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376387502']
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376387502']
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376387502']
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376387502']
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376387502']
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376387502']
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376387502']
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376387502']
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376387502']
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376387502']
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376387502']
2013-08-13 09:51:40 [DEBUG   ] spawn_process: at 2013-08-13 09:51:40 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376387502']
2013-08-13 09:51:40 [INFO    ] Finished spawning TBN in 0.049 s
2013-08-13 09:51:56 [DEBUG   ] Finished updating board flags in 1.515 seconds
2013-08-13 09:52:01 [DEBUG   ] Finished updating ant stats in 1.269 seconds
2013-08-13 09:52:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 09:52:41 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2013-08-13 09:52:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 09:52:56 [DEBUG   ] Finished updating board flags in 1.531 seconds
2013-08-13 09:53:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-13 09:53:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 09:53:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 09:53:57 [DEBUG   ] Finished updating board flags in 2.170 seconds
2013-08-13 09:53:58 [DEBUG   ] Got command TBW from MCS: ref #19690
2013-08-13 09:53:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 09:53:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19690   8 56517 35638019 A NORMAL'
2013-08-13 09:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 09:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 09:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 09:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 09:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 09:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 09:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 09:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 09:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 09:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 09:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 09:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 09:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 09:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 09:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 09:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 09:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 09:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 09:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 09:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 09:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 09:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 09:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 09:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 09:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 09:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 09:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 09:54:01 [DEBUG   ] Got command RPT from MCS: ref #19692
2013-08-13 09:54:01 [DEBUG   ] summary = NORMAL
2013-08-13 09:54:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19692  14 56517 35641407 A NORMALNORMAL'
2013-08-13 09:54:01 [DEBUG   ] Got command RPT from MCS: ref #19693
2013-08-13 09:54:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 09:54:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19693  48 56517 35641407 A NORMALSystem calibrated and operating normally'
2013-08-13 09:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 09:54:01 [DEBUG   ] spawn_process: at 2013-08-13 09:54:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 09:54:01 [INFO    ] Finished spawning TBW
2013-08-13 09:54:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 09:54:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 09:54:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 09:54:57 [DEBUG   ] Finished updating board flags in 1.336 seconds
2013-08-13 09:55:57 [DEBUG   ] Finished updating board flags in 1.770 seconds
2013-08-13 09:56:56 [DEBUG   ] Finished updating board flags in 0.930 seconds
2013-08-13 09:57:39 [INFO    ] __waitForTBW - TBW finished in 218.177 s
2013-08-13 09:57:40 [DEBUG   ] Finished updating ant stats in 0.580 seconds
2013-08-13 09:57:40 [INFO    ] Started antennas statistics background thread
2013-08-13 09:57:40 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376387862']
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376387862']
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376387862']
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376387862']
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376387862']
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376387862']
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376387862']
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376387862']
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376387862']
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376387862']
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376387862']
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376387862']
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376387862']
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376387862']
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376387862']
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376387862']
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376387862']
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376387862']
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376387862']
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376387862']
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376387862']
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376387862']
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376387862']
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376387862']
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376387862']
2013-08-13 09:57:40 [DEBUG   ] spawn_process: at 2013-08-13 09:57:40 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376387862']
2013-08-13 09:57:40 [INFO    ] Finished spawning TBN in 0.049 s
2013-08-13 09:57:57 [DEBUG   ] Finished updating board flags in 1.546 seconds
2013-08-13 09:58:00 [DEBUG   ] Finished updating ant stats in 0.467 seconds
2013-08-13 09:58:20 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-13 09:58:41 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-08-13 09:58:57 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 09:58:57 [DEBUG   ] Finished updating board flags in 1.399 seconds
2013-08-13 09:59:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-13 09:59:01 [DEBUG   ] Got command RPT from MCS: ref #19709
2013-08-13 09:59:01 [DEBUG   ] summary = NORMAL
2013-08-13 09:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19709  14 56517 35941403 A NORMALNORMAL'
2013-08-13 09:59:01 [DEBUG   ] Got command RPT from MCS: ref #19710
2013-08-13 09:59:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 09:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19710  48 56517 35941403 A NORMALSystem calibrated and operating normally'
2013-08-13 09:59:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 09:59:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 09:59:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 09:59:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 09:59:57 [DEBUG   ] Finished updating board flags in 1.367 seconds
2013-08-13 09:59:58 [DEBUG   ] Got command TBW from MCS: ref #19727
2013-08-13 09:59:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 09:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19727   8 56517 35998007 A NORMAL'
2013-08-13 09:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 09:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 09:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 09:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 09:59:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 10:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 10:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 10:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 10:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 10:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 10:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 10:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 10:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 10:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 10:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 10:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 10:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 10:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 10:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 10:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 10:00:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 10:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 10:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 10:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 10:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 10:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 10:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 10:00:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 10:00:01 [DEBUG   ] spawn_process: at 2013-08-13 10:00:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 10:00:01 [INFO    ] Finished spawning TBW
2013-08-13 10:00:58 [DEBUG   ] Finished updating board flags in 1.972 seconds
2013-08-13 10:01:57 [DEBUG   ] Finished updating board flags in 1.139 seconds
2013-08-13 10:02:58 [DEBUG   ] Finished updating board flags in 1.657 seconds
2013-08-13 10:03:40 [INFO    ] __waitForTBW - TBW finished in 218.756 s
2013-08-13 10:03:41 [DEBUG   ] Finished updating ant stats in 0.988 seconds
2013-08-13 10:03:41 [INFO    ] Started antennas statistics background thread
2013-08-13 10:03:41 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376388222']
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376388222']
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376388222']
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376388222']
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376388222']
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376388222']
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376388222']
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376388222']
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376388222']
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376388222']
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376388222']
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376388222']
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376388222']
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376388222']
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376388222']
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376388222']
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376388222']
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376388222']
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376388222']
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376388222']
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376388222']
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376388222']
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376388222']
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376388222']
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376388222']
2013-08-13 10:03:41 [DEBUG   ] spawn_process: at 2013-08-13 10:03:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376388222']
2013-08-13 10:03:41 [INFO    ] Finished spawning TBN in 0.050 s
2013-08-13 10:03:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-08-13 10:03:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 10:03:58 [DEBUG   ] Finished updating board flags in 1.819 seconds
2013-08-13 10:04:01 [DEBUG   ] Finished updating ant stats in 0.870 seconds
2013-08-13 10:04:01 [DEBUG   ] Got command RPT from MCS: ref #19729
2013-08-13 10:04:01 [DEBUG   ] summary = NORMAL
2013-08-13 10:04:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19729  14 56517 36241403 A NORMALNORMAL'
2013-08-13 10:04:01 [DEBUG   ] Got command RPT from MCS: ref #19730
2013-08-13 10:04:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 10:04:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19730  48 56517 36241403 A NORMALSystem calibrated and operating normally'
2013-08-13 10:04:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 10:04:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 10:04:58 [DEBUG   ] Finished updating board flags in 1.657 seconds
2013-08-13 10:05:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 10:05:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 10:05:41 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-13 10:05:58 [DEBUG   ] Got command TBW from MCS: ref #19747
2013-08-13 10:05:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 10:05:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19747   8 56517 36358007 A NORMAL'
2013-08-13 10:05:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 10:05:58 [DEBUG   ] Finished updating board flags in 1.622 seconds
2013-08-13 10:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 10:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 10:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 10:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 10:05:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 10:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 10:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 10:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 10:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 10:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 10:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 10:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 10:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 10:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 10:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 10:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 10:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 10:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 10:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 10:06:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 10:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 10:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 10:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 10:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 10:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 10:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 10:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 10:06:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 10:06:01 [DEBUG   ] spawn_process: at 2013-08-13 10:06:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 10:06:01 [INFO    ] Finished spawning TBW
2013-08-13 10:06:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 10:06:58 [DEBUG   ] Finished updating board flags in 1.385 seconds
2013-08-13 10:07:58 [DEBUG   ] Finished updating board flags in 1.334 seconds
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-08-13 10:08:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-08-13 10:08:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-08-13 10:08:58 [DEBUG   ] Finished updating board flags in 1.222 seconds
2013-08-13 10:09:01 [DEBUG   ] Got command RPT from MCS: ref #19749
2013-08-13 10:09:01 [DEBUG   ] summary = NORMAL
2013-08-13 10:09:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19749  14 56517 36541411 A NORMALNORMAL'
2013-08-13 10:09:01 [DEBUG   ] Got command RPT from MCS: ref #19750
2013-08-13 10:09:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 10:09:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19750  48 56517 36541411 A NORMALSystem calibrated and operating normally'
2013-08-13 10:09:40 [INFO    ] __waitForTBW - TBW finished in 218.586 s
2013-08-13 10:09:41 [INFO    ] Started antennas statistics background thread
2013-08-13 10:09:41 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376388582']
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376388582']
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376388582']
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376388582']
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376388582']
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376388582']
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376388582']
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376388582']
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376388582']
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376388582']
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376388582']
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376388582']
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376388582']
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376388582']
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376388582']
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376388582']
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376388582']
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376388582']
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376388582']
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376388582']
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376388582']
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376388582']
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376388582']
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376388582']
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376388582']
2013-08-13 10:09:41 [DEBUG   ] spawn_process: at 2013-08-13 10:09:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376388582']
2013-08-13 10:09:41 [INFO    ] Finished spawning TBN in 0.051 s
2013-08-13 10:09:41 [DEBUG   ] Finished updating ant stats in 1.182 seconds
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-13 10:09:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-13 10:09:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 10:09:59 [DEBUG   ] Finished updating board flags in 2.408 seconds
2013-08-13 10:10:01 [DEBUG   ] Finished updating ant stats in 0.986 seconds
2013-08-13 10:10:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 10:10:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-08-13 10:10:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-08-13 10:10:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-08-13 10:10:58 [DEBUG   ] Finished updating board flags in 1.336 seconds
2013-08-13 10:11:01 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-08-13 10:11:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 10:11:41 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-13 10:11:58 [DEBUG   ] Got command TBW from MCS: ref #19767
2013-08-13 10:11:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 10:11:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19767   8 56517 36718007 A NORMAL'
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-13 10:11:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-13 10:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-13 10:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-13 10:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-13 10:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-13 10:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-13 10:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-13 10:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-13 10:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-13 10:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-13 10:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-13 10:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-13 10:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-13 10:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-13 10:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-13 10:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-13 10:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-13 10:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 10:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-13 10:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-13 10:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-13 10:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-13 10:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-13 10:12:00 [DEBUG   ] Finished updating board flags in 2.878 seconds
2013-08-13 10:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 10:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 10:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 10:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 10:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 10:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 10:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 10:12:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 10:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 10:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 10:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 10:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 10:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 10:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 10:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 10:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 10:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 10:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 10:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 10:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 10:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 10:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 10:12:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 10:12:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 10:12:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 10:12:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 10:12:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 10:12:02 [DEBUG   ] spawn_process: at 2013-08-13 10:12:02 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 10:12:02 [INFO    ] Finished spawning TBW
2013-08-13 10:12:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:12:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:12:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:12:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:12:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:12:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:12:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:12:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:12:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:12:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:12:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 10:12:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-08-13 10:12:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 10:12:58 [DEBUG   ] Finished updating board flags in 1.303 seconds
2013-08-13 10:13:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:13:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:13:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:13:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:13:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:13:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:13:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:13:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:13:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:13:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:13:59 [DEBUG   ] Finished updating board flags in 1.866 seconds
2013-08-13 10:14:01 [DEBUG   ] Got command RPT from MCS: ref #19769
2013-08-13 10:14:01 [DEBUG   ] summary = NORMAL
2013-08-13 10:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19769  14 56517 36841403 A NORMALNORMAL'
2013-08-13 10:14:01 [DEBUG   ] Got command RPT from MCS: ref #19770
2013-08-13 10:14:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 10:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19770  48 56517 36841403 A NORMALSystem calibrated and operating normally'
2013-08-13 10:14:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:14:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:14:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:14:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:14:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:14:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-08-13 10:14:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:14:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:14:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:14:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:14:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:14:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-08-13 10:14:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 10:14:58 [DEBUG   ] Finished updating board flags in 1.135 seconds
2013-08-13 10:15:41 [INFO    ] __waitForTBW - TBW finished in 218.686 s
2013-08-13 10:15:42 [INFO    ] Started antennas statistics background thread
2013-08-13 10:15:42 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376388943']
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376388943']
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376388943']
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376388943']
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376388943']
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376388943']
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376388943']
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376388943']
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376388943']
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376388943']
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376388943']
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376388943']
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376388943']
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376388943']
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376388943']
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376388943']
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376388943']
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376388943']
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376388943']
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376388943']
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376388943']
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376388943']
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376388943']
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376388943']
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376388943']
2013-08-13 10:15:42 [DEBUG   ] spawn_process: at 2013-08-13 10:15:42 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376388943']
2013-08-13 10:15:42 [INFO    ] Finished spawning TBN in 0.050 s
2013-08-13 10:15:42 [DEBUG   ] Finished updating ant stats in 1.271 seconds
2013-08-13 10:15:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:15:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:15:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:15:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:15:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:15:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:15:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:15:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:15:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:15:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:15:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 10:15:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 10:15:59 [DEBUG   ] Finished updating board flags in 1.742 seconds
2013-08-13 10:16:02 [DEBUG   ] Finished updating ant stats in 1.232 seconds
2013-08-13 10:16:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-13 10:16:42 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 10:16:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:16:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:16:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:16:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:16:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:16:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-08-13 10:16:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:16:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:16:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:16:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:16:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:16:59 [DEBUG   ] Finished updating board flags in 1.615 seconds
2013-08-13 10:17:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 10:17:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 10:17:42 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-13 10:17:58 [DEBUG   ] Got command TBW from MCS: ref #19787
2013-08-13 10:17:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 10:17:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19787   8 56517 37078011 A NORMAL'
2013-08-13 10:17:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:17:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:17:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:17:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:17:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:18:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:18:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:18:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:18:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:18:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 10:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 10:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 10:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 10:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 10:18:00 [DEBUG   ] Finished updating board flags in 2.593 seconds
2013-08-13 10:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 10:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 10:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 10:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 10:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 10:18:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 10:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 10:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 10:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 10:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 10:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 10:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 10:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 10:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 10:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 10:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 10:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 10:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 10:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 10:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 10:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 10:18:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 10:18:02 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 10:18:02 [DEBUG   ] spawn_process: at 2013-08-13 10:18:02 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 10:18:02 [INFO    ] Finished spawning TBW
2013-08-13 10:18:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:18:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:18:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:18:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:18:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:18:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:18:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:18:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:18:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:18:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:18:59 [DEBUG   ] Finished updating board flags in 1.322 seconds
2013-08-13 10:19:01 [DEBUG   ] Got command RPT from MCS: ref #19789
2013-08-13 10:19:01 [DEBUG   ] summary = NORMAL
2013-08-13 10:19:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19789  14 56517 37141411 A NORMALNORMAL'
2013-08-13 10:19:01 [DEBUG   ] Got command RPT from MCS: ref #19790
2013-08-13 10:19:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 10:19:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19790  48 56517 37141411 A NORMALSystem calibrated and operating normally'
2013-08-13 10:19:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:19:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:19:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:19:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:19:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:19:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-08-13 10:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:19:59 [DEBUG   ] Finished updating board flags in 1.089 seconds
2013-08-13 10:20:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:20:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:20:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:20:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:20:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:21:00 [DEBUG   ] Finished updating board flags in 2.126 seconds
2013-08-13 10:21:41 [INFO    ] __waitForTBW - TBW finished in 218.890 s
2013-08-13 10:21:42 [INFO    ] Started antennas statistics background thread
2013-08-13 10:21:42 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376389303']
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376389303']
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376389303']
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376389303']
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376389303']
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376389303']
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376389303']
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376389303']
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376389303']
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376389303']
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376389303']
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376389303']
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376389303']
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376389303']
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376389303']
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376389303']
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376389303']
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376389303']
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376389303']
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376389303']
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376389303']
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376389303']
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376389303']
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376389303']
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376389303']
2013-08-13 10:21:42 [DEBUG   ] spawn_process: at 2013-08-13 10:21:42 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376389303']
2013-08-13 10:21:42 [INFO    ] Finished spawning TBN in 0.050 s
2013-08-13 10:21:42 [DEBUG   ] Finished updating ant stats in 1.271 seconds
2013-08-13 10:21:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:21:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:21:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:21:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:21:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:22:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:22:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:22:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:22:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:22:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:22:00 [DEBUG   ] Finished updating board flags in 2.213 seconds
2013-08-13 10:22:02 [DEBUG   ] Finished updating ant stats in 1.236 seconds
2013-08-13 10:22:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 10:22:42 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 10:22:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:22:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:22:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:22:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:22:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:22:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2013-08-13 10:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:23:00 [DEBUG   ] Finished updating board flags in 2.061 seconds
2013-08-13 10:23:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-13 10:23:22 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-13 10:23:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 10:23:58 [DEBUG   ] Got command TBW from MCS: ref #19807
2013-08-13 10:23:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 10:23:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19807   8 56517 37438015 A NORMAL'
2013-08-13 10:23:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:23:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:23:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:23:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:23:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 10:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 10:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 10:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 10:23:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 10:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 10:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 10:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 10:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 10:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 10:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 10:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 10:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 10:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 10:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 10:24:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 10:24:00 [DEBUG   ] Finished updating board flags in 1.999 seconds
2013-08-13 10:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 10:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 10:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 10:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 10:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 10:24:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 10:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 10:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 10:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 10:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 10:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 10:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 10:24:01 [DEBUG   ] Got command RPT from MCS: ref #19809
2013-08-13 10:24:01 [DEBUG   ] summary = NORMAL
2013-08-13 10:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19809  14 56517 37441407 A NORMALNORMAL'
2013-08-13 10:24:01 [DEBUG   ] Got command RPT from MCS: ref #19810
2013-08-13 10:24:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 10:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19810  48 56517 37441407 A NORMALSystem calibrated and operating normally'
2013-08-13 10:24:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 10:24:01 [DEBUG   ] spawn_process: at 2013-08-13 10:24:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 10:24:01 [INFO    ] Finished spawning TBW
2013-08-13 10:24:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:24:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:24:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:24:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:24:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:25:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:25:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:25:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:25:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:25:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:25:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-08-13 10:25:00 [DEBUG   ] Finished updating board flags in 1.608 seconds
2013-08-13 10:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:26:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:26:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:26:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:26:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:26:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:26:00 [DEBUG   ] Finished updating board flags in 1.725 seconds
2013-08-13 10:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:27:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:27:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:27:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:27:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:27:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:27:00 [DEBUG   ] Finished updating board flags in 1.473 seconds
2013-08-13 10:27:39 [INFO    ] __waitForTBW - TBW finished in 218.112 s
2013-08-13 10:27:40 [DEBUG   ] Finished updating ant stats in 0.619 seconds
2013-08-13 10:27:40 [INFO    ] Started antennas statistics background thread
2013-08-13 10:27:40 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376389662']
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376389662']
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376389662']
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376389662']
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376389662']
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376389662']
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376389662']
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376389662']
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376389662']
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376389662']
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376389662']
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376389662']
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376389662']
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376389662']
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376389662']
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376389662']
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376389662']
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376389662']
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376389662']
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376389662']
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376389662']
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376389662']
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376389662']
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376389662']
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376389662']
2013-08-13 10:27:40 [DEBUG   ] spawn_process: at 2013-08-13 10:27:40 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376389662']
2013-08-13 10:27:40 [INFO    ] Finished spawning TBN in 0.048 s
2013-08-13 10:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:28:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:28:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:28:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:28:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:28:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:28:00 [DEBUG   ] Finished updating ant stats in 0.711 seconds
2013-08-13 10:28:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 10:28:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 10:28:00 [DEBUG   ] Finished updating board flags in 1.668 seconds
2013-08-13 10:28:20 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2013-08-13 10:28:41 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-08-13 10:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:29:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:29:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:29:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:29:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:29:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:29:00 [DEBUG   ] Finished updating board flags in 1.575 seconds
2013-08-13 10:29:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-13 10:29:01 [DEBUG   ] Got command RPT from MCS: ref #19826
2013-08-13 10:29:01 [DEBUG   ] summary = NORMAL
2013-08-13 10:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19826  14 56517 37741411 A NORMALNORMAL'
2013-08-13 10:29:01 [DEBUG   ] Got command RPT from MCS: ref #19827
2013-08-13 10:29:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 10:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19827  48 56517 37741411 A NORMALSystem calibrated and operating normally'
2013-08-13 10:29:21 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-13 10:29:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-13 10:29:58 [DEBUG   ] Got command TBW from MCS: ref #19844
2013-08-13 10:29:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 10:29:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19844   8 56517 37798011 A NORMAL'
2013-08-13 10:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 10:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 10:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 10:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 10:29:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 10:30:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:30:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:30:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:30:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:30:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 10:30:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 10:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 10:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 10:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 10:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 10:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 10:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 10:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 10:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 10:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 10:30:00 [DEBUG   ] Finished updating board flags in 1.358 seconds
2013-08-13 10:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 10:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 10:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 10:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 10:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 10:30:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 10:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 10:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 10:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 10:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 10:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 10:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 10:30:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 10:30:01 [DEBUG   ] spawn_process: at 2013-08-13 10:30:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 10:30:01 [INFO    ] Finished spawning TBW
2013-08-13 10:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:30:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:31:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:31:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:31:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:31:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:31:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:31:00 [DEBUG   ] Finished updating board flags in 1.204 seconds
2013-08-13 10:31:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:31:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:31:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:31:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:31:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:32:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:32:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:32:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:32:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:32:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:32:00 [DEBUG   ] Finished updating board flags in 1.005 seconds
2013-08-13 10:33:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:33:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:33:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:33:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:33:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:33:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2013-08-13 10:33:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:33:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:33:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:33:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:33:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:33:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 10:33:01 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 10:33:01 [DEBUG   ] Finished updating board flags in 2.124 seconds
2013-08-13 10:33:40 [INFO    ] __waitForTBW - TBW finished in 218.601 s
2013-08-13 10:33:41 [INFO    ] Started antennas statistics background thread
2013-08-13 10:33:41 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376390022']
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376390022']
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376390022']
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376390022']
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376390022']
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376390022']
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376390022']
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376390022']
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376390022']
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376390022']
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376390022']
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376390022']
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376390022']
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376390022']
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376390022']
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376390022']
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376390022']
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376390022']
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376390022']
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376390022']
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376390022']
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376390022']
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376390022']
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376390022']
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376390022']
2013-08-13 10:33:41 [DEBUG   ] spawn_process: at 2013-08-13 10:33:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376390022']
2013-08-13 10:33:41 [INFO    ] Finished spawning TBN in 0.050 s
2013-08-13 10:33:41 [DEBUG   ] Finished updating ant stats in 1.244 seconds
2013-08-13 10:34:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:34:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:34:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:34:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:34:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:34:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:34:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:34:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:34:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:34:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:34:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-08-13 10:34:01 [DEBUG   ] Finished updating ant stats in 1.241 seconds
2013-08-13 10:34:01 [DEBUG   ] Got command RPT from MCS: ref #19846
2013-08-13 10:34:01 [DEBUG   ] summary = NORMAL
2013-08-13 10:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19846  14 56517 38041415 A NORMALNORMAL'
2013-08-13 10:34:01 [DEBUG   ] Got command RPT from MCS: ref #19847
2013-08-13 10:34:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 10:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19847  48 56517 38041416 A NORMALSystem calibrated and operating normally'
2013-08-13 10:34:01 [DEBUG   ] Finished updating board flags in 2.287 seconds
2013-08-13 10:34:21 [DEBUG   ] Finished updating ant stats in 1.145 seconds
2013-08-13 10:34:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 10:35:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:35:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:35:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:35:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:35:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:35:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:35:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:35:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:35:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:35:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:35:01 [DEBUG   ] Finished updating ant stats in 1.045 seconds
2013-08-13 10:35:01 [DEBUG   ] Finished updating board flags in 2.040 seconds
2013-08-13 10:35:21 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2013-08-13 10:35:41 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-13 10:35:58 [DEBUG   ] Got command TBW from MCS: ref #19864
2013-08-13 10:35:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 10:35:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19864   8 56517 38158007 A NORMAL'
2013-08-13 10:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 10:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 10:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 10:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 10:35:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 10:36:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:36:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:36:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:36:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:36:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 10:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 10:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 10:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 10:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 10:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 10:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 10:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 10:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 10:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 10:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 10:36:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 10:36:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:36:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:36:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:36:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:36:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 10:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 10:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 10:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 10:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 10:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 10:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 10:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 10:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 10:36:01 [DEBUG   ] Finished updating board flags in 2.019 seconds
2013-08-13 10:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 10:36:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 10:36:01 [DEBUG   ] spawn_process: at 2013-08-13 10:36:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 10:36:01 [INFO    ] Finished spawning TBW
2013-08-13 10:37:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-08-13 10:37:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-08-13 10:37:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-08-13 10:37:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-08-13 10:37:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-08-13 10:37:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-08-13 10:37:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-08-13 10:37:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-08-13 10:37:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-08-13 10:37:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-08-13 10:37:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 10:37:01 [DEBUG   ] Finished updating board flags in 1.853 seconds
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-08-13 10:38:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-08-13 10:38:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 10:38:01 [DEBUG   ] Finished updating board flags in 1.718 seconds
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-13 10:39:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-13 10:39:01 [DEBUG   ] Got command RPT from MCS: ref #19866
2013-08-13 10:39:01 [DEBUG   ] summary = NORMAL
2013-08-13 10:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19866  14 56517 38341416 A NORMALNORMAL'
2013-08-13 10:39:01 [DEBUG   ] Got command RPT from MCS: ref #19867
2013-08-13 10:39:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 10:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19867  48 56517 38341416 A NORMALSystem calibrated and operating normally'
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-13 10:39:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 10:39:01 [DEBUG   ] Finished updating board flags in 1.720 seconds
2013-08-13 10:39:40 [INFO    ] __waitForTBW - TBW finished in 218.286 s
2013-08-13 10:39:41 [INFO    ] Started antennas statistics background thread
2013-08-13 10:39:41 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376390382']
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376390382']
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376390382']
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376390382']
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376390382']
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376390382']
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376390382']
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376390382']
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376390382']
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376390382']
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376390382']
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376390382']
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376390382']
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376390382']
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376390382']
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376390382']
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376390382']
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376390382']
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376390382']
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376390382']
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376390382']
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376390382']
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376390382']
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376390382']
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376390382']
2013-08-13 10:39:41 [DEBUG   ] spawn_process: at 2013-08-13 10:39:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376390382']
2013-08-13 10:39:41 [INFO    ] Finished spawning TBN in 0.052 s
2013-08-13 10:39:41 [DEBUG   ] Finished updating ant stats in 1.165 seconds
2013-08-13 10:40:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 10:40:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 10:40:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 10:40:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 10:40:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 10:40:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 10:40:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 10:40:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 10:40:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 10:40:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 10:40:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-08-13 10:40:01 [DEBUG   ] Finished updating ant stats in 1.042 seconds
2013-08-13 10:40:01 [DEBUG   ] Finished updating board flags in 1.851 seconds
2013-08-13 10:40:21 [DEBUG   ] Finished updating ant stats in 0.946 seconds
2013-08-13 10:40:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 10:41:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 10:41:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 10:41:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 10:41:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 10:41:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 10:41:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 10:41:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 10:41:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 10:41:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 10:41:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 10:41:01 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2013-08-13 10:41:01 [DEBUG   ] Finished updating board flags in 1.658 seconds
2013-08-13 10:41:21 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2013-08-13 10:41:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 10:41:58 [DEBUG   ] Got command TBW from MCS: ref #19884
2013-08-13 10:41:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 10:41:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19884   8 56517 38518011 A NORMAL'
2013-08-13 10:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 10:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 10:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 10:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 10:41:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 10:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 10:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 10:42:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 10:42:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 10:42:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 10:42:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 10:42:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 10:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 10:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 10:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 10:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 10:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 10:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 10:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 10:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 10:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 10:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 10:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 10:42:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 10:42:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 10:42:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 10:42:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 10:42:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 10:42:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 10:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 10:42:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 10:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 10:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 10:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 10:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 10:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 10:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 10:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 10:42:01 [DEBUG   ] Finished updating board flags in 1.505 seconds
2013-08-13 10:42:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 10:42:01 [DEBUG   ] spawn_process: at 2013-08-13 10:42:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 10:42:01 [INFO    ] Finished spawning TBW
2013-08-13 10:43:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 10:43:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 10:43:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 10:43:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 10:43:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 10:43:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-08-13 10:43:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 10:43:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 10:43:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 10:43:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 10:43:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 10:43:01 [DEBUG   ] Finished updating board flags in 1.353 seconds
2013-08-13 10:44:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 10:44:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 10:44:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 10:44:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 10:44:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 10:44:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2013-08-13 10:44:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-08-13 10:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 10:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 10:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 10:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 10:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 10:44:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 10:44:01 [DEBUG   ] Got command RPT from MCS: ref #19886
2013-08-13 10:44:01 [DEBUG   ] summary = NORMAL
2013-08-13 10:44:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19886  14 56517 38641419 A NORMALNORMAL'
2013-08-13 10:44:01 [DEBUG   ] Got command RPT from MCS: ref #19887
2013-08-13 10:44:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 10:44:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19887  48 56517 38641419 A NORMALSystem calibrated and operating normally'
2013-08-13 10:44:01 [DEBUG   ] Finished updating board flags in 1.096 seconds
2013-08-13 10:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 10:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 10:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 10:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 10:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 10:45:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2013-08-13 10:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 10:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 10:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 10:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 10:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 10:45:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 10:45:02 [DEBUG   ] Finished updating board flags in 2.129 seconds
2013-08-13 10:45:39 [INFO    ] __waitForTBW - TBW finished in 218.233 s
2013-08-13 10:45:40 [INFO    ] Started antennas statistics background thread
2013-08-13 10:45:40 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 10:45:40 [DEBUG   ] spawn_process: at 2013-08-13 10:45:40 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376390742']
2013-08-13 10:45:40 [DEBUG   ] spawn_process: at 2013-08-13 10:45:40 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376390742']
2013-08-13 10:45:40 [DEBUG   ] spawn_process: at 2013-08-13 10:45:40 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376390742']
2013-08-13 10:45:40 [DEBUG   ] spawn_process: at 2013-08-13 10:45:40 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376390742']
2013-08-13 10:45:40 [DEBUG   ] spawn_process: at 2013-08-13 10:45:40 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376390742']
2013-08-13 10:45:40 [DEBUG   ] spawn_process: at 2013-08-13 10:45:40 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376390742']
2013-08-13 10:45:40 [DEBUG   ] spawn_process: at 2013-08-13 10:45:40 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376390742']
2013-08-13 10:45:40 [DEBUG   ] spawn_process: at 2013-08-13 10:45:40 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376390742']
2013-08-13 10:45:40 [DEBUG   ] spawn_process: at 2013-08-13 10:45:40 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376390742']
2013-08-13 10:45:40 [DEBUG   ] spawn_process: at 2013-08-13 10:45:40 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376390742']
2013-08-13 10:45:40 [DEBUG   ] spawn_process: at 2013-08-13 10:45:40 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376390742']
2013-08-13 10:45:40 [DEBUG   ] spawn_process: at 2013-08-13 10:45:40 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376390742']
2013-08-13 10:45:40 [DEBUG   ] spawn_process: at 2013-08-13 10:45:40 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376390742']
2013-08-13 10:45:40 [DEBUG   ] spawn_process: at 2013-08-13 10:45:40 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376390742']
2013-08-13 10:45:40 [DEBUG   ] spawn_process: at 2013-08-13 10:45:40 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376390742']
2013-08-13 10:45:40 [DEBUG   ] spawn_process: at 2013-08-13 10:45:40 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376390742']
2013-08-13 10:45:40 [DEBUG   ] spawn_process: at 2013-08-13 10:45:40 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376390742']
2013-08-13 10:45:40 [DEBUG   ] spawn_process: at 2013-08-13 10:45:40 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376390742']
2013-08-13 10:45:40 [DEBUG   ] spawn_process: at 2013-08-13 10:45:40 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376390742']
2013-08-13 10:45:41 [DEBUG   ] spawn_process: at 2013-08-13 10:45:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376390742']
2013-08-13 10:45:41 [DEBUG   ] spawn_process: at 2013-08-13 10:45:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376390742']
2013-08-13 10:45:41 [DEBUG   ] spawn_process: at 2013-08-13 10:45:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376390742']
2013-08-13 10:45:41 [DEBUG   ] spawn_process: at 2013-08-13 10:45:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376390742']
2013-08-13 10:45:41 [DEBUG   ] spawn_process: at 2013-08-13 10:45:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376390742']
2013-08-13 10:45:41 [DEBUG   ] spawn_process: at 2013-08-13 10:45:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376390742']
2013-08-13 10:45:41 [DEBUG   ] spawn_process: at 2013-08-13 10:45:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376390742']
2013-08-13 10:45:41 [INFO    ] Finished spawning TBN in 0.051 s
2013-08-13 10:45:41 [DEBUG   ] Finished updating ant stats in 1.291 seconds
2013-08-13 10:46:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 10:46:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 10:46:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 10:46:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 10:46:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 10:46:01 [DEBUG   ] Finished updating ant stats in 1.327 seconds
2013-08-13 10:46:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 10:46:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 10:46:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 10:46:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 10:46:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 10:46:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-08-13 10:46:02 [DEBUG   ] Finished updating board flags in 2.189 seconds
2013-08-13 10:46:21 [DEBUG   ] Finished updating ant stats in 1.145 seconds
2013-08-13 10:46:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 10:47:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 10:47:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 10:47:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 10:47:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 10:47:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 10:47:01 [DEBUG   ] Finished updating ant stats in 1.055 seconds
2013-08-13 10:47:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 10:47:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 10:47:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 10:47:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 10:47:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 10:47:02 [DEBUG   ] Finished updating board flags in 1.859 seconds
2013-08-13 10:47:21 [DEBUG   ] Finished updating ant stats in 0.949 seconds
2013-08-13 10:47:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 10:47:58 [DEBUG   ] Got command TBW from MCS: ref #19904
2013-08-13 10:47:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 10:47:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19904   8 56517 38878007 A NORMAL'
2013-08-13 10:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 10:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 10:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 10:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 10:47:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 10:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 10:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 10:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 10:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 10:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 10:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 10:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 10:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 10:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 10:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 10:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 10:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 10:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 10:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 10:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 10:48:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 10:48:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 10:48:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 10:48:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 10:48:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 10:48:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 10:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 10:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 10:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 10:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 10:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 10:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 10:48:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 10:48:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 10:48:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 10:48:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 10:48:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 10:48:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 10:48:01 [DEBUG   ] spawn_process: at 2013-08-13 10:48:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 10:48:01 [INFO    ] Finished spawning TBW
2013-08-13 10:48:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 10:48:01 [DEBUG   ] Finished updating board flags in 1.068 seconds
2013-08-13 10:49:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 10:49:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 10:49:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 10:49:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 10:49:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 10:49:01 [DEBUG   ] Got command RPT from MCS: ref #19906
2013-08-13 10:49:01 [DEBUG   ] summary = NORMAL
2013-08-13 10:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19906  14 56517 38941419 A NORMALNORMAL'
2013-08-13 10:49:01 [DEBUG   ] Got command RPT from MCS: ref #19907
2013-08-13 10:49:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 10:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19907  48 56517 38941420 A NORMALSystem calibrated and operating normally'
2013-08-13 10:49:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 10:49:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 10:49:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 10:49:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 10:49:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 10:49:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 10:49:02 [DEBUG   ] Finished updating board flags in 1.681 seconds
2013-08-13 10:50:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 10:50:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 10:50:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 10:50:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 10:50:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 10:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 10:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 10:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 10:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 10:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 10:50:02 [DEBUG   ] Finished updating board flags in 1.471 seconds
2013-08-13 10:51:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 10:51:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 10:51:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 10:51:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 10:51:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 10:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 10:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 10:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 10:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 10:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 10:51:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 10:51:02 [DEBUG   ] Finished updating board flags in 1.526 seconds
2013-08-13 10:51:40 [INFO    ] __waitForTBW - TBW finished in 218.713 s
2013-08-13 10:51:41 [INFO    ] Started antennas statistics background thread
2013-08-13 10:51:41 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376391102']
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376391102']
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376391102']
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376391102']
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376391102']
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376391102']
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376391102']
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376391102']
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376391102']
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376391102']
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376391102']
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376391102']
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376391102']
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376391102']
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376391102']
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376391102']
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376391102']
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376391102']
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376391102']
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376391102']
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376391102']
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376391102']
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376391102']
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376391102']
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376391102']
2013-08-13 10:51:41 [DEBUG   ] spawn_process: at 2013-08-13 10:51:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376391102']
2013-08-13 10:51:41 [INFO    ] Finished spawning TBN in 0.049 s
2013-08-13 10:51:41 [DEBUG   ] Finished updating ant stats in 1.132 seconds
2013-08-13 10:52:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 10:52:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 10:52:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 10:52:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 10:52:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 10:52:01 [DEBUG   ] Finished updating ant stats in 1.042 seconds
2013-08-13 10:52:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 10:52:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 10:52:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 10:52:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 10:52:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 10:52:02 [DEBUG   ] Finished updating board flags in 1.657 seconds
2013-08-13 10:52:21 [DEBUG   ] Finished updating ant stats in 0.946 seconds
2013-08-13 10:52:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 10:53:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 10:53:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 10:53:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 10:53:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 10:53:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 10:53:01 [DEBUG   ] Finished updating ant stats in 0.856 seconds
2013-08-13 10:53:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 10:53:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 10:53:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 10:53:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 10:53:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 10:53:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-08-13 10:53:02 [DEBUG   ] Finished updating board flags in 1.652 seconds
2013-08-13 10:53:21 [DEBUG   ] Finished updating ant stats in 0.747 seconds
2013-08-13 10:53:41 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2013-08-13 10:53:58 [DEBUG   ] Got command TBW from MCS: ref #19924
2013-08-13 10:53:58 [DEBUG   ] tbw = exited with status True, code 0x00
2013-08-13 10:53:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW    19924   8 56517 39238007 A NORMAL'
2013-08-13 10:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2013-08-13 10:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2013-08-13 10:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2013-08-13 10:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2013-08-13 10:53:59 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2013-08-13 10:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2013-08-13 10:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2013-08-13 10:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2013-08-13 10:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2013-08-13 10:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2013-08-13 10:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2013-08-13 10:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2013-08-13 10:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2013-08-13 10:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2013-08-13 10:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2013-08-13 10:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2013-08-13 10:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2013-08-13 10:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2013-08-13 10:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2013-08-13 10:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2013-08-13 10:54:00 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2013-08-13 10:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2013-08-13 10:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2013-08-13 10:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2013-08-13 10:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2013-08-13 10:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2013-08-13 10:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 10:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 10:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 10:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 10:54:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 10:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2013-08-13 10:54:01 [DEBUG   ] Got command RPT from MCS: ref #19926
2013-08-13 10:54:01 [DEBUG   ] summary = NORMAL
2013-08-13 10:54:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19926  14 56517 39241415 A NORMALNORMAL'
2013-08-13 10:54:01 [DEBUG   ] Got command RPT from MCS: ref #19927
2013-08-13 10:54:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 10:54:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19927  48 56517 39241416 A NORMALSystem calibrated and operating normally'
2013-08-13 10:54:01 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2013-08-13 10:54:01 [DEBUG   ] spawn_process: at 2013-08-13 10:54:01 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2013-08-13 10:54:01 [INFO    ] Finished spawning TBW
2013-08-13 10:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 10:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 10:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 10:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 10:57:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 10:57:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 10:57:39 [DEBUG   ] Finished updating board flags in 218.303 seconds
2013-08-13 10:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 10:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 10:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 10:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 10:57:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 10:57:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2013-08-13 10:57:40 [INFO    ] __waitForTBW - TBW finished in 218.664 s
2013-08-13 10:57:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 10:57:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 10:57:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 10:57:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 10:57:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 10:57:41 [INFO    ] Started antennas statistics background thread
2013-08-13 10:57:41 [INFO    ] Resuming TBN at 37.900 MHz after TBW acquisition
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1376391462']
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1376391462']
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1376391462']
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1376391462']
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1376391462']
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1376391462']
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1376391462']
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1376391462']
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1376391462']
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1376391462']
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1376391462']
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1376391462']
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1376391462']
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1376391462']
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1376391462']
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1376391462']
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1376391462']
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1376391462']
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1376391462']
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1376391462']
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1376391462']
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1376391462']
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1376391462']
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1376391462']
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1376391462']
2013-08-13 10:57:41 [DEBUG   ] spawn_process: at 2013-08-13 10:57:41 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1376391462']
2013-08-13 10:57:41 [INFO    ] Finished spawning TBN in 0.052 s
2013-08-13 10:57:41 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-08-13 10:57:41 [DEBUG   ] Finished updating board flags in 2.000 seconds
2013-08-13 10:58:01 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2013-08-13 10:58:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 10:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 10:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 10:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 10:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 10:58:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 10:58:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 10:58:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 10:58:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 10:58:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 10:58:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 10:58:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-08-13 10:58:41 [DEBUG   ] Finished updating ant stats in 1.044 seconds
2013-08-13 10:58:41 [DEBUG   ] Finished updating board flags in 1.930 seconds
2013-08-13 10:59:01 [DEBUG   ] Finished updating ant stats in 0.963 seconds
2013-08-13 10:59:01 [DEBUG   ] Got command RPT from MCS: ref #19943
2013-08-13 10:59:01 [DEBUG   ] summary = NORMAL
2013-08-13 10:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19943  14 56517 39541419 A NORMALNORMAL'
2013-08-13 10:59:01 [DEBUG   ] Got command RPT from MCS: ref #19944
2013-08-13 10:59:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 10:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19944  48 56517 39541419 A NORMALSystem calibrated and operating normally'
2013-08-13 10:59:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 10:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 10:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 10:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 10:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 10:59:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 10:59:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 10:59:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 10:59:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 10:59:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 10:59:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 10:59:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 10:59:41 [DEBUG   ] Finished updating ant stats in 0.649 seconds
2013-08-13 10:59:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 10:59:41 [DEBUG   ] Finished updating board flags in 1.784 seconds
2013-08-13 11:00:01 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2013-08-13 11:00:22 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2013-08-13 11:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:00:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:00:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:00:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:00:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:00:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:00:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:00:41 [DEBUG   ] Finished updating board flags in 1.645 seconds
2013-08-13 11:00:42 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-13 11:01:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 11:01:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 11:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:01:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:01:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:01:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:01:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:01:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:01:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:01:41 [DEBUG   ] Finished updating board flags in 1.612 seconds
2013-08-13 11:01:42 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-13 11:02:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 11:02:22 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 11:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:02:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:02:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:02:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:02:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:02:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:02:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:02:41 [DEBUG   ] Finished updating board flags in 1.597 seconds
2013-08-13 11:02:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 11:03:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 11:03:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 11:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:03:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:03:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:03:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:03:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:03:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:03:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:03:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 11:03:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 11:03:41 [DEBUG   ] Finished updating board flags in 1.515 seconds
2013-08-13 11:03:42 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 11:04:01 [DEBUG   ] Got command RPT from MCS: ref #19960
2013-08-13 11:04:01 [DEBUG   ] summary = NORMAL
2013-08-13 11:04:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19960  14 56517 39841415 A NORMALNORMAL'
2013-08-13 11:04:01 [DEBUG   ] Got command RPT from MCS: ref #19961
2013-08-13 11:04:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 11:04:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19961  48 56517 39841415 A NORMALSystem calibrated and operating normally'
2013-08-13 11:04:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 11:04:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 11:04:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:04:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:04:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:04:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:04:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:04:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:04:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:04:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:04:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:04:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:04:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 11:04:42 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2013-08-13 11:04:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 11:04:42 [DEBUG   ] Finished updating board flags in 2.271 seconds
2013-08-13 11:05:02 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2013-08-13 11:05:22 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-08-13 11:05:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:05:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:05:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:05:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:05:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:05:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:05:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:05:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:05:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:05:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:05:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 11:05:42 [DEBUG   ] Finished updating board flags in 2.181 seconds
2013-08-13 11:05:43 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-08-13 11:06:03 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-08-13 11:06:23 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-08-13 11:06:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:06:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:06:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:06:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:06:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:06:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:06:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:06:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:06:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:06:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:06:42 [DEBUG   ] Finished updating board flags in 2.039 seconds
2013-08-13 11:06:43 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-13 11:07:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 11:07:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 11:07:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:07:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:07:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:07:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:07:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:07:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:07:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:07:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:07:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:07:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:07:42 [DEBUG   ] Finished updating board flags in 2.016 seconds
2013-08-13 11:07:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 11:08:03 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2013-08-13 11:08:23 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 11:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:08:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:08:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:08:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:08:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:08:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:08:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:08:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 11:08:42 [DEBUG   ] Finished updating board flags in 1.939 seconds
2013-08-13 11:08:43 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 11:09:01 [DEBUG   ] Got command RPT from MCS: ref #19977
2013-08-13 11:09:01 [DEBUG   ] summary = NORMAL
2013-08-13 11:09:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19977  14 56517 40141419 A NORMALNORMAL'
2013-08-13 11:09:01 [DEBUG   ] Got command RPT from MCS: ref #19978
2013-08-13 11:09:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 11:09:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19978  48 56517 40141419 A NORMALSystem calibrated and operating normally'
2013-08-13 11:09:03 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-13 11:09:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-08-13 11:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:09:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:09:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 11:09:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-08-13 11:09:42 [DEBUG   ] Finished updating board flags in 1.759 seconds
2013-08-13 11:09:44 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-08-13 11:10:04 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2013-08-13 11:10:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 11:10:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:10:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:10:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:10:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:10:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:10:42 [DEBUG   ] Finished updating board flags in 1.618 seconds
2013-08-13 11:10:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 11:11:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 11:11:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 11:11:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:11:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:11:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:11:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:11:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:11:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:11:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:11:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:11:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:11:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:11:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 11:11:42 [DEBUG   ] Finished updating board flags in 1.605 seconds
2013-08-13 11:11:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 11:12:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 11:12:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 11:12:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:12:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:12:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:12:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:12:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:12:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:12:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:12:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:12:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:12:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:12:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 11:12:42 [DEBUG   ] Finished updating board flags in 1.589 seconds
2013-08-13 11:12:44 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 11:13:05 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-08-13 11:13:25 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-08-13 11:13:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:13:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:13:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:13:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:13:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:13:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:13:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:13:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:13:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:13:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:13:42 [DEBUG   ] Finished updating board flags in 1.400 seconds
2013-08-13 11:13:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-13 11:14:01 [DEBUG   ] Got command RPT from MCS: ref #19994
2013-08-13 11:14:01 [DEBUG   ] summary = NORMAL
2013-08-13 11:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19994  14 56517 40441419 A NORMALNORMAL'
2013-08-13 11:14:01 [DEBUG   ] Got command RPT from MCS: ref #19995
2013-08-13 11:14:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 11:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    19995  48 56517 40441419 A NORMALSystem calibrated and operating normally'
2013-08-13 11:14:05 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-13 11:14:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 11:14:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:14:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:14:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:14:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:14:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:14:42 [DEBUG   ] Finished updating board flags in 1.354 seconds
2013-08-13 11:14:45 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 11:15:05 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-13 11:15:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 11:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:15:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:15:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:15:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:15:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:15:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:15:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:15:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 11:15:43 [DEBUG   ] Finished updating board flags in 2.064 seconds
2013-08-13 11:15:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 11:16:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 11:16:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 11:16:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:16:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:16:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:16:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:16:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:16:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:16:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:16:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:16:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:16:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:16:43 [DEBUG   ] Finished updating board flags in 1.982 seconds
2013-08-13 11:16:45 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-13 11:17:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 11:17:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 11:17:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:17:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:17:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:17:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:17:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:17:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:17:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:17:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:17:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:17:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:17:43 [DEBUG   ] Finished updating board flags in 1.819 seconds
2013-08-13 11:17:45 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-13 11:18:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 11:18:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-13 11:18:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:18:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:18:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:18:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:18:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:18:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-08-13 11:18:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:18:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:18:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:18:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:18:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:18:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 11:18:43 [DEBUG   ] Finished updating board flags in 1.841 seconds
2013-08-13 11:18:45 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-08-13 11:19:01 [DEBUG   ] Got command RPT from MCS: ref #20011
2013-08-13 11:19:01 [DEBUG   ] summary = NORMAL
2013-08-13 11:19:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20011  14 56517 40741419 A NORMALNORMAL'
2013-08-13 11:19:01 [DEBUG   ] Got command RPT from MCS: ref #20012
2013-08-13 11:19:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 11:19:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20012  48 56517 40741419 A NORMALSystem calibrated and operating normally'
2013-08-13 11:19:06 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-08-13 11:19:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 11:19:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:19:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:19:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:19:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:19:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:19:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:19:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:19:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:19:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:19:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:19:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 11:19:43 [DEBUG   ] Finished updating board flags in 1.752 seconds
2013-08-13 11:19:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 11:20:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-13 11:20:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 11:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:20:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:20:43 [DEBUG   ] Finished updating board flags in 1.619 seconds
2013-08-13 11:20:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 11:21:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 11:21:26 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-13 11:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:21:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:21:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 11:21:43 [DEBUG   ] Finished updating board flags in 1.591 seconds
2013-08-13 11:21:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 11:22:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 11:22:26 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 11:22:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:22:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:22:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:22:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:22:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:22:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:22:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:22:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:22:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:22:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:22:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 11:22:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 11:22:43 [DEBUG   ] Finished updating board flags in 1.407 seconds
2013-08-13 11:22:46 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-13 11:23:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 11:23:26 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 11:23:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:23:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:23:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:23:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:23:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:23:43 [DEBUG   ] Finished updating board flags in 1.437 seconds
2013-08-13 11:23:46 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-08-13 11:24:01 [DEBUG   ] Got command RPT from MCS: ref #20028
2013-08-13 11:24:01 [DEBUG   ] summary = NORMAL
2013-08-13 11:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20028  14 56517 41041423 A NORMALNORMAL'
2013-08-13 11:24:01 [DEBUG   ] Got command RPT from MCS: ref #20029
2013-08-13 11:24:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 11:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20029  48 56517 41041423 A NORMALSystem calibrated and operating normally'
2013-08-13 11:24:07 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-08-13 11:24:27 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-13 11:24:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:24:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:24:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:24:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:24:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:24:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-08-13 11:24:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-08-13 11:24:43 [DEBUG   ] Finished updating board flags in 1.413 seconds
2013-08-13 11:24:47 [DEBUG   ] Finished updating ant stats in 1.008 seconds
2013-08-13 11:25:07 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-13 11:25:27 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 11:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:25:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:25:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 11:25:43 [DEBUG   ] Finished updating board flags in 1.358 seconds
2013-08-13 11:25:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 11:26:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 11:26:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 11:26:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:26:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:26:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:26:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:26:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:26:44 [DEBUG   ] Finished updating board flags in 2.202 seconds
2013-08-13 11:26:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-13 11:27:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-13 11:27:27 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-13 11:27:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:27:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:27:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:27:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:27:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:27:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:27:43 [DEBUG   ] Finished updating board flags in 1.336 seconds
2013-08-13 11:27:47 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-13 11:28:08 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-08-13 11:28:28 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-08-13 11:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:28:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:28:44 [DEBUG   ] Finished updating board flags in 2.070 seconds
2013-08-13 11:28:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 11:29:01 [DEBUG   ] Got command RPT from MCS: ref #20045
2013-08-13 11:29:01 [DEBUG   ] summary = NORMAL
2013-08-13 11:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20045  14 56517 41341423 A NORMALNORMAL'
2013-08-13 11:29:01 [DEBUG   ] Got command RPT from MCS: ref #20046
2013-08-13 11:29:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 11:29:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20046  48 56517 41341423 A NORMALSystem calibrated and operating normally'
2013-08-13 11:29:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 11:29:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 11:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:29:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:29:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 11:29:44 [DEBUG   ] Finished updating board flags in 1.985 seconds
2013-08-13 11:29:48 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-13 11:30:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 11:30:28 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 11:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:30:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:30:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 11:30:44 [DEBUG   ] Finished updating board flags in 1.824 seconds
2013-08-13 11:30:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-13 11:31:09 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-08-13 11:31:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-13 11:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:31:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:31:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-08-13 11:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:31:44 [DEBUG   ] Finished updating board flags in 1.794 seconds
2013-08-13 11:31:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 11:32:09 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-13 11:32:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-08-13 11:32:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:32:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:32:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:32:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:32:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:32:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 11:32:44 [DEBUG   ] Finished updating board flags in 1.611 seconds
2013-08-13 11:32:49 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 11:33:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 11:33:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 11:33:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:33:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:33:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:33:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:33:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:33:44 [DEBUG   ] Finished updating board flags in 1.588 seconds
2013-08-13 11:33:49 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-13 11:34:01 [DEBUG   ] Got command RPT from MCS: ref #20062
2013-08-13 11:34:01 [DEBUG   ] summary = NORMAL
2013-08-13 11:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20062  14 56517 41641427 A NORMALNORMAL'
2013-08-13 11:34:01 [DEBUG   ] Got command RPT from MCS: ref #20063
2013-08-13 11:34:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 11:34:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20063  48 56517 41641427 A NORMALSystem calibrated and operating normally'
2013-08-13 11:34:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 11:34:29 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 11:34:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:34:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:34:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:34:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:34:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:34:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2013-08-13 11:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:34:44 [DEBUG   ] Finished updating board flags in 1.417 seconds
2013-08-13 11:34:49 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-13 11:35:10 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-08-13 11:35:30 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-13 11:35:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:35:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:35:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:35:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:35:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:35:44 [DEBUG   ] Finished updating board flags in 1.383 seconds
2013-08-13 11:35:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-13 11:36:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 11:36:30 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 11:36:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:36:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:36:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:36:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:36:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:36:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-08-13 11:36:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 11:36:44 [DEBUG   ] Finished updating board flags in 1.354 seconds
2013-08-13 11:36:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 11:37:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-13 11:37:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 11:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:37:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 11:37:45 [DEBUG   ] Finished updating board flags in 2.079 seconds
2013-08-13 11:37:50 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-08-13 11:38:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 11:38:30 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-13 11:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:38:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:38:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:38:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:38:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:38:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:38:45 [DEBUG   ] Finished updating board flags in 1.975 seconds
2013-08-13 11:38:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 11:39:01 [DEBUG   ] Got command RPT from MCS: ref #20079
2013-08-13 11:39:01 [DEBUG   ] summary = NORMAL
2013-08-13 11:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20079  14 56517 41941423 A NORMALNORMAL'
2013-08-13 11:39:01 [DEBUG   ] Got command RPT from MCS: ref #20080
2013-08-13 11:39:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 11:39:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20080  48 56517 41941423 A NORMALSystem calibrated and operating normally'
2013-08-13 11:39:10 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 11:39:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 11:39:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:39:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:39:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:39:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:39:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:39:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:39:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:39:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:39:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:39:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:39:45 [DEBUG   ] Finished updating board flags in 1.818 seconds
2013-08-13 11:39:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 11:40:10 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2013-08-13 11:40:31 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-08-13 11:40:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:40:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:40:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:40:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:40:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:40:45 [DEBUG   ] Finished updating board flags in 1.798 seconds
2013-08-13 11:40:51 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-08-13 11:41:11 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 11:41:31 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 11:41:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:41:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:41:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:41:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:41:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:41:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-08-13 11:41:45 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 11:41:45 [DEBUG   ] Finished updating board flags in 1.597 seconds
2013-08-13 11:41:51 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-13 11:42:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 11:42:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 11:42:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:42:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:42:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:42:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:42:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:42:45 [DEBUG   ] Finished updating board flags in 1.412 seconds
2013-08-13 11:42:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 11:43:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 11:43:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-08-13 11:43:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:43:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:43:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:43:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:43:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:43:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 11:43:45 [DEBUG   ] Finished updating board flags in 1.385 seconds
2013-08-13 11:43:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 11:44:01 [DEBUG   ] Got command RPT from MCS: ref #20096
2013-08-13 11:44:01 [DEBUG   ] summary = NORMAL
2013-08-13 11:44:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20096  14 56517 42241427 A NORMALNORMAL'
2013-08-13 11:44:01 [DEBUG   ] Got command RPT from MCS: ref #20097
2013-08-13 11:44:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 11:44:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20097  48 56517 42241427 A NORMALSystem calibrated and operating normally'
2013-08-13 11:44:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 11:44:32 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-08-13 11:44:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:44:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:44:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:44:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:44:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:44:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 11:44:45 [DEBUG   ] Finished updating board flags in 1.351 seconds
2013-08-13 11:44:51 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-13 11:45:12 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-08-13 11:45:32 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-08-13 11:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:45:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:45:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:45:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:45:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:45:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:45:46 [DEBUG   ] Finished updating board flags in 2.069 seconds
2013-08-13 11:45:52 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2013-08-13 11:46:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 11:46:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 11:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-08-13 11:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-08-13 11:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-08-13 11:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-08-13 11:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-08-13 11:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-08-13 11:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-08-13 11:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-08-13 11:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-08-13 11:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-08-13 11:46:46 [DEBUG   ] Finished updating board flags in 1.991 seconds
2013-08-13 11:46:52 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-13 11:47:12 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 11:47:32 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-08-13 11:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-08-13 11:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-08-13 11:47:46 [DEBUG   ] Finished updating board flags in 1.830 seconds
2013-08-13 11:47:52 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-13 11:48:12 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-13 11:48:33 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-08-13 11:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-08-13 11:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-08-13 11:48:46 [DEBUG   ] Finished updating board flags in 1.782 seconds
2013-08-13 11:48:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-13 11:49:01 [DEBUG   ] Got command RPT from MCS: ref #20113
2013-08-13 11:49:01 [DEBUG   ] summary = NORMAL
2013-08-13 11:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20113  14 56517 42541423 A NORMALNORMAL'
2013-08-13 11:49:01 [DEBUG   ] Got command RPT from MCS: ref #20114
2013-08-13 11:49:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 11:49:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20114  48 56517 42541423 A NORMALSystem calibrated and operating normally'
2013-08-13 11:49:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-13 11:49:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 11:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 11:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 11:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 11:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 11:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 11:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 11:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 11:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 11:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 11:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 11:49:46 [DEBUG   ] Finished updating board flags in 1.598 seconds
2013-08-13 11:49:53 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2013-08-13 11:50:13 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-08-13 11:50:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 11:50:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 11:50:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 11:50:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 11:50:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 11:50:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 11:50:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 11:50:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 11:50:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 11:50:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 11:50:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 11:50:46 [DEBUG   ] Finished updating board flags in 1.411 seconds
2013-08-13 11:50:53 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-13 11:51:13 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 11:51:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 11:51:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 11:51:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 11:51:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 11:51:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 11:51:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 11:51:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 11:51:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 11:51:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 11:51:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 11:51:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 11:51:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 11:51:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-08-13 11:51:46 [DEBUG   ] Finished updating board flags in 1.413 seconds
2013-08-13 11:51:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 11:52:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 11:52:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-13 11:52:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 11:52:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 11:52:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 11:52:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 11:52:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 11:52:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 11:52:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 11:52:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 11:52:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 11:52:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 11:52:46 [DEBUG   ] Finished updating board flags in 1.377 seconds
2013-08-13 11:52:54 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-08-13 11:53:14 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-13 11:53:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 11:53:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 11:53:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 11:53:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 11:53:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 11:53:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 11:53:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 11:53:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 11:53:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 11:53:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 11:53:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 11:53:46 [DEBUG   ] Finished updating board flags in 1.371 seconds
2013-08-13 11:53:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 11:54:01 [DEBUG   ] Got command RPT from MCS: ref #20130
2013-08-13 11:54:01 [DEBUG   ] summary = NORMAL
2013-08-13 11:54:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20130  14 56517 42841423 A NORMALNORMAL'
2013-08-13 11:54:01 [DEBUG   ] Got command RPT from MCS: ref #20131
2013-08-13 11:54:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 11:54:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20131  48 56517 42841423 A NORMALSystem calibrated and operating normally'
2013-08-13 11:54:14 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-13 11:54:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 11:54:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 11:54:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 11:54:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 11:54:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 11:54:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 11:54:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 11:54:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 11:54:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 11:54:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 11:54:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 11:54:47 [DEBUG   ] Finished updating board flags in 2.045 seconds
2013-08-13 11:54:54 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-08-13 11:55:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 11:55:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 11:55:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 11:55:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 11:55:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 11:55:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 11:55:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 11:55:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 11:55:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 11:55:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 11:55:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 11:55:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 11:55:47 [DEBUG   ] Finished updating board flags in 1.981 seconds
2013-08-13 11:55:54 [DEBUG   ] Finished updating ant stats in 0.593 seconds
2013-08-13 11:56:15 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-08-13 11:56:35 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-08-13 11:56:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 11:56:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 11:56:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 11:56:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 11:56:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 11:56:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 11:56:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 11:56:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 11:56:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 11:56:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 11:56:47 [DEBUG   ] Finished updating board flags in 1.822 seconds
2013-08-13 11:56:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 11:57:15 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 11:57:35 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-13 11:57:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 11:57:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 11:57:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 11:57:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 11:57:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 11:57:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 11:57:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 11:57:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 11:57:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 11:57:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 11:57:47 [DEBUG   ] Finished updating board flags in 1.781 seconds
2013-08-13 11:57:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-08-13 11:58:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 11:58:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 11:58:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 11:58:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 11:58:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 11:58:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 11:58:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 11:58:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 11:58:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 11:58:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 11:58:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 11:58:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 11:58:47 [DEBUG   ] Finished updating board flags in 1.612 seconds
2013-08-13 11:58:55 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-08-13 11:59:01 [DEBUG   ] Got command RPT from MCS: ref #20147
2013-08-13 11:59:01 [DEBUG   ] summary = NORMAL
2013-08-13 11:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20147  14 56517 43141431 A NORMALNORMAL'
2013-08-13 11:59:01 [DEBUG   ] Got command RPT from MCS: ref #20148
2013-08-13 11:59:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 11:59:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20148  48 56517 43141431 A NORMALSystem calibrated and operating normally'
2013-08-13 11:59:16 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-08-13 11:59:36 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-13 11:59:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 11:59:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 11:59:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 11:59:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 11:59:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 11:59:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 11:59:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 11:59:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 11:59:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 11:59:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 11:59:47 [DEBUG   ] Finished updating board flags in 1.591 seconds
2013-08-13 11:59:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-08-13 12:00:16 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-13 12:00:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 12:00:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 12:00:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 12:00:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 12:00:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 12:00:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 12:00:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-08-13 12:00:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 12:00:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 12:00:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 12:00:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 12:00:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 12:00:47 [DEBUG   ] Finished updating board flags in 1.420 seconds
2013-08-13 12:00:56 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 12:01:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 12:01:36 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-13 12:01:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 12:01:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 12:01:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 12:01:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 12:01:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 12:01:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 12:01:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 12:01:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 12:01:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 12:01:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 12:01:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 12:01:47 [DEBUG   ] Finished updating board flags in 1.384 seconds
2013-08-13 12:01:56 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2013-08-13 12:02:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 12:02:37 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-08-13 12:02:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 12:02:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 12:02:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 12:02:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 12:02:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 12:02:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 12:02:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 12:02:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 12:02:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 12:02:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 12:02:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 12:02:47 [DEBUG   ] Finished updating board flags in 1.375 seconds
2013-08-13 12:02:56 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-13 12:03:17 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-08-13 12:03:37 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-08-13 12:03:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 12:03:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 12:03:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 12:03:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 12:03:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 12:03:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 12:03:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 12:03:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 12:03:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 12:03:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 12:03:48 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 12:03:48 [DEBUG   ] Finished updating board flags in 2.041 seconds
2013-08-13 12:03:57 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-08-13 12:04:01 [DEBUG   ] Got command RPT from MCS: ref #20164
2013-08-13 12:04:01 [DEBUG   ] summary = NORMAL
2013-08-13 12:04:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20164  14 56517 43441431 A NORMALNORMAL'
2013-08-13 12:04:01 [DEBUG   ] Got command RPT from MCS: ref #20165
2013-08-13 12:04:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 12:04:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20165  48 56517 43441431 A NORMALSystem calibrated and operating normally'
2013-08-13 12:04:17 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 12:04:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 12:04:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 12:04:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 12:04:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 12:04:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 12:04:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 12:04:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 12:04:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 12:04:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 12:04:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 12:04:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 12:04:48 [DEBUG   ] Finished updating board flags in 2.009 seconds
2013-08-13 12:04:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-13 12:05:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 12:05:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 12:05:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 12:05:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 12:05:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 12:05:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 12:05:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 12:05:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 12:05:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 12:05:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 12:05:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 12:05:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 12:05:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-08-13 12:05:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 12:05:48 [DEBUG   ] Finished updating board flags in 1.987 seconds
2013-08-13 12:05:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 12:06:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 12:06:37 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-08-13 12:06:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 12:06:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 12:06:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 12:06:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 12:06:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 12:06:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa27, chip 5
2013-08-13 12:06:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 12:06:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 12:06:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 12:06:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 12:06:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 12:06:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-08-13 12:06:48 [DEBUG   ] Finished updating board flags in 1.812 seconds
2013-08-13 12:06:57 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 12:07:17 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-08-13 12:07:37 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-13 12:07:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 12:07:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 12:07:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 12:07:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 12:07:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 12:07:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-08-13 12:07:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 12:07:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 12:07:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 12:07:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 12:07:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 12:07:48 [DEBUG   ] Finished updating board flags in 1.805 seconds
2013-08-13 12:07:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-08-13 12:08:17 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-13 12:08:38 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-08-13 12:08:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 12:08:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 12:08:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 12:08:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 12:08:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 12:08:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 12:08:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 12:08:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 12:08:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 12:08:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 12:08:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-08-13 12:08:48 [DEBUG   ] Finished updating board flags in 1.785 seconds
2013-08-13 12:08:57 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-13 12:09:01 [DEBUG   ] Got command RPT from MCS: ref #20181
2013-08-13 12:09:01 [DEBUG   ] summary = NORMAL
2013-08-13 12:09:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20181  14 56517 43741435 A NORMALNORMAL'
2013-08-13 12:09:01 [DEBUG   ] Got command RPT from MCS: ref #20182
2013-08-13 12:09:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 12:09:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20182  48 56517 43741435 A NORMALSystem calibrated and operating normally'
2013-08-13 12:09:18 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-08-13 12:09:38 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-08-13 12:09:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 12:09:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 12:09:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 12:09:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 12:09:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 12:09:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 12:09:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 12:09:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 12:09:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 12:09:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 12:09:48 [DEBUG   ] Finished updating board flags in 1.611 seconds
2013-08-13 12:09:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-08-13 12:10:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 12:10:38 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-08-13 12:10:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 12:10:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 12:10:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 12:10:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 12:10:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 12:10:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 12:10:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 12:10:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 12:10:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 12:10:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 12:10:48 [DEBUG   ] Finished updating board flags in 1.593 seconds
2013-08-13 12:10:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 12:11:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-08-13 12:11:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-08-13 12:11:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 12:11:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 12:11:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 12:11:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 12:11:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 12:11:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 12:11:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 12:11:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 12:11:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 12:11:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 12:11:48 [DEBUG   ] Finished updating board flags in 1.408 seconds
2013-08-13 12:11:58 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-08-13 12:12:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 12:12:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-08-13 12:12:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 12:12:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 12:12:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 12:12:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 12:12:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 12:12:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 12:12:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 12:12:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 12:12:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 12:12:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 12:12:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 12:12:48 [DEBUG   ] Finished updating board flags in 1.394 seconds
2013-08-13 12:12:58 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 12:13:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 12:13:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 12:13:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 12:13:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 12:13:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 12:13:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 12:13:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 12:13:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 12:13:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 12:13:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 12:13:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 12:13:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 12:13:48 [DEBUG   ] Finished updating board flags in 1.373 seconds
2013-08-13 12:13:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 12:14:01 [DEBUG   ] Got command RPT from MCS: ref #20198
2013-08-13 12:14:01 [DEBUG   ] summary = NORMAL
2013-08-13 12:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20198  14 56517 44041435 A NORMALNORMAL'
2013-08-13 12:14:01 [DEBUG   ] Got command RPT from MCS: ref #20199
2013-08-13 12:14:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 12:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20199  48 56517 44041435 A NORMALSystem calibrated and operating normally'
2013-08-13 12:14:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-08-13 12:14:38 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 12:14:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 12:14:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 12:14:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 12:14:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 12:14:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 12:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 12:14:49 [DEBUG   ] Finished updating board flags in 2.056 seconds
2013-08-13 12:14:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-08-13 12:15:18 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-13 12:15:39 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-08-13 12:15:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 12:15:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 12:15:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 12:15:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 12:15:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 12:15:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-08-13 12:15:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 12:15:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 12:15:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 12:15:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 12:15:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 12:15:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 12:15:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 12:15:49 [DEBUG   ] Finished updating board flags in 1.970 seconds
2013-08-13 12:15:59 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-08-13 12:16:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-08-13 12:16:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 12:16:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 12:16:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 12:16:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 12:16:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 12:16:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 12:16:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 12:16:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 12:16:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 12:16:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 12:16:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 12:16:49 [DEBUG   ] Finished updating board flags in 1.819 seconds
2013-08-13 12:16:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-08-13 12:17:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-08-13 12:17:39 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2013-08-13 12:17:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 12:17:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 12:17:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 12:17:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 12:17:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 12:17:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-08-13 12:17:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 12:17:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 12:17:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 12:17:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 12:17:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 12:17:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 12:17:49 [DEBUG   ] Finished updating board flags in 1.815 seconds
2013-08-13 12:17:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-08-13 12:18:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-08-13 12:18:40 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-08-13 12:18:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 12:18:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 12:18:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 12:18:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 12:18:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 12:18:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 12:18:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 12:18:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 12:18:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 12:18:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 12:18:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 12:18:49 [DEBUG   ] Finished updating board flags in 1.783 seconds
2013-08-13 12:18:59 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2013-08-13 12:19:01 [DEBUG   ] Got command RPT from MCS: ref #20215
2013-08-13 12:19:01 [DEBUG   ] summary = NORMAL
2013-08-13 12:19:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20215  14 56517 44341431 A NORMALNORMAL'
2013-08-13 12:19:01 [DEBUG   ] Got command RPT from MCS: ref #20216
2013-08-13 12:19:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 12:19:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20216  48 56517 44341431 A NORMALSystem calibrated and operating normally'
2013-08-13 12:19:19 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-08-13 12:19:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 12:19:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 12:19:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 12:19:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 12:19:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 12:19:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 12:19:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 12:19:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 12:19:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 12:19:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 12:19:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 12:19:49 [DEBUG   ] Finished updating board flags in 1.614 seconds
2013-08-13 12:20:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 12:20:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-08-13 12:20:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 12:20:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 12:20:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 12:20:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 12:20:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 12:20:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 12:20:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 12:20:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 12:20:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 12:20:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 12:20:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 12:20:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 12:20:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-08-13 12:20:49 [DEBUG   ] Finished updating board flags in 1.589 seconds
2013-08-13 12:21:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-08-13 12:21:20 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-08-13 12:21:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-08-13 12:21:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 12:21:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 12:21:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 12:21:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 12:21:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 12:21:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 12:21:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 12:21:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 12:21:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 12:21:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 12:21:49 [DEBUG   ] Finished updating board flags in 1.451 seconds
2013-08-13 12:22:00 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-08-13 12:22:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-08-13 12:22:40 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-08-13 12:22:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 12:22:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 12:22:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 12:22:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 12:22:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 12:22:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 12:22:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 12:22:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 12:22:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 12:22:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 12:22:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 12:22:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 12:22:49 [DEBUG   ] Finished updating board flags in 1.436 seconds
2013-08-13 12:23:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-08-13 12:23:20 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-08-13 12:23:41 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-08-13 12:23:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 12:23:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 12:23:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 12:23:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 12:23:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 12:23:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 12:23:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 12:23:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 12:23:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 12:23:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 12:23:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-08-13 12:23:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-08-13 12:23:49 [DEBUG   ] Finished updating board flags in 1.425 seconds
2013-08-13 12:24:00 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-08-13 12:24:01 [DEBUG   ] Got command RPT from MCS: ref #20232
2013-08-13 12:24:01 [DEBUG   ] summary = NORMAL
2013-08-13 12:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20232  14 56517 44641435 A NORMALNORMAL'
2013-08-13 12:24:01 [DEBUG   ] Got command RPT from MCS: ref #20233
2013-08-13 12:24:01 [DEBUG   ] info = System calibrated and operating normally
2013-08-13 12:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    20233  48 56517 44641435 A NORMALSystem calibrated and operating normally'
2013-08-13 12:24:20 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-08-13 12:24:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-08-13 12:24:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-08-13 12:24:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-08-13 12:24:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-08-13 12:24:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-08-13 12:24:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-08-13 12:24:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-08-13 12:24:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-08-13 12:24:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-08-13 12:24:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-08-13 12:24:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-08-13 12:24:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-08-13 12:24:49 [DEBUG   ] Finished updating board flags in 1.433 seconds
2013-08-13 12:25:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
