2013-06-18 12:25:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:25:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:25:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:25:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 12:25:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 12:25:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 12:25:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 12:25:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 12:25:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2013-06-18 12:25:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2013-06-18 12:25:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2013-06-18 12:25:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 1
2013-06-18 12:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 12:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 12:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 12:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 12:25:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 12:25:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2013-06-18 12:25:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2013-06-18 12:25:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa35, chip 1
2013-06-18 12:25:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2013-06-18 12:25:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 2
2013-06-18 12:25:59 [DEBUG   ] Finished updating board flags in 2.204 seconds
2013-06-18 12:26:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:26:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 12:26:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 12:26:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 12:26:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 12:26:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 12:26:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 12:26:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 12:26:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2013-06-18 12:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 12:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 12:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 12:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 12:26:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 12:26:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2013-06-18 12:26:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2013-06-18 12:26:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2013-06-18 12:26:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2013-06-18 12:26:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa6, chip 5
2013-06-18 12:26:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 3
2013-06-18 12:26:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 12:26:59 [DEBUG   ] Finished updating board flags in 2.137 seconds
2013-06-18 12:27:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 12:27:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 12:27:40 [DEBUG   ] Got command RPT from MCS: ref #7825
2013-06-18 12:27:40 [DEBUG   ] summary = NORMAL
2013-06-18 12:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7825  14 56461 44860469 A NORMALNORMAL'
2013-06-18 12:27:40 [DEBUG   ] Got command RPT from MCS: ref #7826
2013-06-18 12:27:40 [DEBUG   ] info = System calibrated and operating normally
2013-06-18 12:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7826  48 56461 44860470 A NORMALSystem calibrated and operating normally'
2013-06-18 12:27:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 12:27:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 12:27:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 12:27:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 12:27:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 12:27:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 12:27:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 2
2013-06-18 12:27:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2013-06-18 12:27:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2013-06-18 12:27:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 3
2013-06-18 12:27:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 5
2013-06-18 12:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 12:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 12:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 12:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 12:27:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 12:27:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 12:27:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-06-18 12:27:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2013-06-18 12:27:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2013-06-18 12:27:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2013-06-18 12:27:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2013-06-18 12:27:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 12:27:59 [DEBUG   ] Finished updating board flags in 2.016 seconds
2013-06-18 12:28:05 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-18 12:28:25 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-18 12:28:45 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-18 12:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 12:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 12:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 12:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 12:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 12:28:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 1
2013-06-18 12:28:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2013-06-18 12:28:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 1
2013-06-18 12:28:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2013-06-18 12:28:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 5
2013-06-18 12:28:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2013-06-18 12:28:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 1
2013-06-18 12:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 12:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 12:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 12:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 12:28:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 12:28:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 1
2013-06-18 12:28:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2013-06-18 12:28:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2013-06-18 12:28:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2013-06-18 12:28:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2013-06-18 12:28:59 [DEBUG   ] Finished updating board flags in 2.007 seconds
2013-06-18 12:29:05 [DEBUG   ] Finished updating ant stats in 0.392 seconds
2013-06-18 12:29:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 12:29:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 12:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 12:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 12:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 12:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 12:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 12:29:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2013-06-18 12:29:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2013-06-18 12:29:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2013-06-18 12:29:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2013-06-18 12:29:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2013-06-18 12:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 12:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 12:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 12:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 12:29:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 12:29:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 12:29:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2013-06-18 12:29:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 5
2013-06-18 12:29:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2013-06-18 12:29:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 3
2013-06-18 12:29:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2013-06-18 12:29:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2013-06-18 12:29:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 5
2013-06-18 12:29:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 5
2013-06-18 12:29:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 12:29:59 [DEBUG   ] Finished updating board flags in 1.979 seconds
2013-06-18 12:30:00 [DEBUG   ] Got command INI from MCS: ref #7842
2013-06-18 12:30:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2013-06-18 12:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI     7842   8 56461 45000598 ABOOTING'
2013-06-18 12:30:21 [INFO    ] -------------------
2013-06-18 12:30:21 [INFO    ]  LWA board status
2013-06-18 12:30:21 [INFO    ] -------------------
2013-06-18 12:30:21 [INFO    ] DP 1: 2 lwa27
2013-06-18 12:30:21 [INFO    ] DP 1: 3 lwa24
2013-06-18 12:30:21 [INFO    ] DP 1: 4 lwa23
2013-06-18 12:30:21 [INFO    ] DP 1: 5 lwa18
2013-06-18 12:30:21 [INFO    ] DP 1: 6 lwa10
2013-06-18 12:30:21 [INFO    ] DP 1: 7 lwa32
2013-06-18 12:30:21 [INFO    ] DP 1: 8 lwa11
2013-06-18 12:30:21 [INFO    ] DP 1: 9 lwa30
2013-06-18 12:30:21 [INFO    ] DP 1: 10 lwa12
2013-06-18 12:30:21 [INFO    ] DP 1: 11 lwa8
2013-06-18 12:30:21 [INFO    ] DP 1: 12 lwa13
2013-06-18 12:30:21 [INFO    ] DP 1: 13 lwa26
2013-06-18 12:30:21 [INFO    ] DP 1: 14 lwa14
2013-06-18 12:30:21 [INFO    ] DP 1: 16 lwa22
2013-06-18 12:30:21 [INFO    ] DP 1: 17 lwa20
2013-06-18 12:30:21 [INFO    ] DP 1: 18 lwa1
2013-06-18 12:30:21 [INFO    ] DP 1: 19 lwa5
2013-06-18 12:30:21 [INFO    ] DP 1: 20 lwa25
2013-06-18 12:30:21 [INFO    ] DP 1: 21 lwa35
2013-06-18 12:30:21 [INFO    ] DP 1: 22 lwa19
2013-06-18 12:30:21 [INFO    ] DP 1: 23 lwa21
2013-06-18 12:30:21 [INFO    ] DP 1: 24 lwa6
2013-06-18 12:30:21 [INFO    ] DP 1: 25 lwa7
2013-06-18 12:30:21 [INFO    ] DP 1: 26 lwa33
2013-06-18 12:30:21 [INFO    ] DP 1: 27 lwa15
2013-06-18 12:30:21 [INFO    ] DP 1: 28 lwa28
2013-06-18 12:30:21 [INFO    ] DP 2: 1 lwa16
2013-06-18 12:30:21 [INFO    ] DP 2: 15 lwa34
2013-06-18 12:30:21 [INFO    ] Total of 28 boards
2013-06-18 12:30:21 [INFO    ] Total of 260 stands
2013-06-18 12:30:21 [INFO    ] -------------------
2013-06-18 12:30:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32032
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32033
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32034
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32035
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32036
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32037
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32038
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32039
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32040
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32041
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32042
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32043
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32044
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32045
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32046
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32047
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32048
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32049
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32050
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32051
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32052
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32053
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32054
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32055
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32056
2013-06-18 12:30:28 [DEBUG   ] 2013-06-18 12:30:28 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32057
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32032 exited with status 0
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32033 exited with status 0
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32034 exited with status 0
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32035 exited with status 0
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32036 exited with status 0
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32037 exited with status 0
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32038 exited with status 0
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32039 exited with status 0
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32040 exited with status 0
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32041 exited with status 0
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32042 exited with status 0
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32043 exited with status 0
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32044 exited with status 0
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32045 exited with status 0
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32046 exited with status 0
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32047 exited with status 0
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32048 exited with status 0
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32049 exited with status 0
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32050 exited with status 0
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32051 exited with status 0
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32052 exited with status 0
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32053 exited with status 0
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32054 exited with status 0
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32055 exited with status 0
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32056 exited with status 0
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32057 exited with status 0
2013-06-18 12:30:40 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] spawn_process: at 2013-06-18 12:30:40 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 32084
2013-06-18 12:30:40 [DEBUG   ] 2013-06-18 12:30:40 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 32085
2013-06-18 12:30:46 [DEBUG   ] 2013-06-18 12:30:46 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 32084 exited with status 0
2013-06-18 12:30:46 [DEBUG   ] 2013-06-18 12:30:46 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 32085 exited with status 0
2013-06-18 12:30:46 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2013-06-18 12:30:46 [DEBUG   ] spawn_process: at 2013-06-18 12:30:46 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2013-06-18 12:30:46 [DEBUG   ] spawn_process: at 2013-06-18 12:30:46 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2013-06-18 12:30:46 [INFO    ] Setting Beam 1 xbars
2013-06-18 12:30:46 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2013-06-18 12:30:46 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2013-06-18 12:30:46 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2013-06-18 12:30:46 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2013-06-18 12:30:46 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2013-06-18 12:30:47 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2013-06-18 12:30:47 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2013-06-18 12:30:47 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2013-06-18 12:30:47 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2013-06-18 12:30:47 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2013-06-18 12:30:47 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2013-06-18 12:30:47 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2013-06-18 12:30:47 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2013-06-18 12:30:47 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2013-06-18 12:30:48 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2013-06-18 12:30:48 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2013-06-18 12:30:48 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2013-06-18 12:30:48 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2013-06-18 12:30:48 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2013-06-18 12:30:48 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2013-06-18 12:30:48 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2013-06-18 12:30:48 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2013-06-18 12:30:48 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2013-06-18 12:30:49 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2013-06-18 12:30:49 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2013-06-18 12:30:49 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2013-06-18 12:30:49 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2013-06-18 12:30:49 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2013-06-18 12:30:49 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2013-06-18 12:30:49 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2013-06-18 12:30:49 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2013-06-18 12:30:49 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2013-06-18 12:30:50 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2013-06-18 12:30:50 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2013-06-18 12:30:50 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2013-06-18 12:30:50 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2013-06-18 12:30:50 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2013-06-18 12:30:50 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2013-06-18 12:30:50 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2013-06-18 12:30:50 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2013-06-18 12:30:50 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2013-06-18 12:30:50 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2013-06-18 12:30:51 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2013-06-18 12:30:51 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2013-06-18 12:30:51 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2013-06-18 12:30:51 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2013-06-18 12:30:51 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2013-06-18 12:30:51 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2013-06-18 12:30:51 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2013-06-18 12:30:51 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2013-06-18 12:30:51 [INFO    ] Setting Beam 2 xbars
2013-06-18 12:30:51 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2013-06-18 12:30:52 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2013-06-18 12:30:52 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2013-06-18 12:30:52 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2013-06-18 12:30:52 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2013-06-18 12:30:52 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2013-06-18 12:30:52 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2013-06-18 12:30:52 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2013-06-18 12:30:52 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2013-06-18 12:30:52 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2013-06-18 12:30:53 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2013-06-18 12:30:53 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2013-06-18 12:30:53 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2013-06-18 12:30:53 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2013-06-18 12:30:53 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2013-06-18 12:30:53 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2013-06-18 12:30:53 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2013-06-18 12:30:53 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2013-06-18 12:30:53 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2013-06-18 12:30:54 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2013-06-18 12:30:54 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2013-06-18 12:30:54 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2013-06-18 12:30:54 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2013-06-18 12:30:54 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2013-06-18 12:30:54 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2013-06-18 12:30:54 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2013-06-18 12:30:54 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2013-06-18 12:30:54 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2013-06-18 12:30:55 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2013-06-18 12:30:55 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2013-06-18 12:30:55 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2013-06-18 12:30:55 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2013-06-18 12:30:55 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2013-06-18 12:30:55 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2013-06-18 12:30:55 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2013-06-18 12:30:55 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2013-06-18 12:30:55 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2013-06-18 12:30:55 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2013-06-18 12:30:56 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2013-06-18 12:30:56 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2013-06-18 12:30:56 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2013-06-18 12:30:56 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2013-06-18 12:30:56 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2013-06-18 12:30:56 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2013-06-18 12:30:56 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2013-06-18 12:30:56 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2013-06-18 12:30:56 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2013-06-18 12:30:57 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2013-06-18 12:30:57 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2013-06-18 12:30:57 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2013-06-18 12:30:57 [INFO    ] Setting Beam 3 xbars
2013-06-18 12:30:57 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2013-06-18 12:30:57 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2013-06-18 12:30:57 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2013-06-18 12:30:57 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2013-06-18 12:30:57 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2013-06-18 12:30:57 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2013-06-18 12:30:58 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2013-06-18 12:30:58 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2013-06-18 12:30:58 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2013-06-18 12:30:58 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2013-06-18 12:30:58 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2013-06-18 12:30:58 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2013-06-18 12:30:58 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2013-06-18 12:30:58 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2013-06-18 12:30:58 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2013-06-18 12:30:59 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2013-06-18 12:30:59 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2013-06-18 12:30:59 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2013-06-18 12:30:59 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2013-06-18 12:30:59 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2013-06-18 12:30:59 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2013-06-18 12:30:59 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2013-06-18 12:30:59 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2013-06-18 12:30:59 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2013-06-18 12:31:00 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2013-06-18 12:31:00 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2013-06-18 12:31:00 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2013-06-18 12:31:00 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2013-06-18 12:31:00 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2013-06-18 12:31:00 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2013-06-18 12:31:00 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2013-06-18 12:31:00 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2013-06-18 12:31:00 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2013-06-18 12:31:00 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2013-06-18 12:31:01 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2013-06-18 12:31:01 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2013-06-18 12:31:01 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2013-06-18 12:31:01 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2013-06-18 12:31:01 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2013-06-18 12:31:01 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2013-06-18 12:31:01 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2013-06-18 12:31:01 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2013-06-18 12:31:01 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2013-06-18 12:31:02 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2013-06-18 12:31:02 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2013-06-18 12:31:02 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2013-06-18 12:31:02 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2013-06-18 12:31:02 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2013-06-18 12:31:02 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2013-06-18 12:31:02 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2013-06-18 12:31:02 [INFO    ] Setting Beam 4 xbars
2013-06-18 12:31:02 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2013-06-18 12:31:02 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2013-06-18 12:31:03 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2013-06-18 12:31:03 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2013-06-18 12:31:03 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2013-06-18 12:31:03 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2013-06-18 12:31:03 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2013-06-18 12:31:03 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2013-06-18 12:31:03 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2013-06-18 12:31:03 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2013-06-18 12:31:03 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2013-06-18 12:31:04 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2013-06-18 12:31:04 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2013-06-18 12:31:04 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2013-06-18 12:31:04 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2013-06-18 12:31:04 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2013-06-18 12:31:04 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2013-06-18 12:31:04 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2013-06-18 12:31:04 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2013-06-18 12:31:04 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2013-06-18 12:31:05 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2013-06-18 12:31:05 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2013-06-18 12:31:05 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2013-06-18 12:31:05 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2013-06-18 12:31:05 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2013-06-18 12:31:05 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2013-06-18 12:31:05 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2013-06-18 12:31:05 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2013-06-18 12:31:05 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2013-06-18 12:31:06 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2013-06-18 12:31:06 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2013-06-18 12:31:06 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2013-06-18 12:31:06 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2013-06-18 12:31:06 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2013-06-18 12:31:06 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2013-06-18 12:31:06 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2013-06-18 12:31:06 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2013-06-18 12:31:06 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2013-06-18 12:31:06 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2013-06-18 12:31:07 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2013-06-18 12:31:07 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2013-06-18 12:31:07 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2013-06-18 12:31:07 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2013-06-18 12:31:07 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2013-06-18 12:31:07 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2013-06-18 12:31:07 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2013-06-18 12:31:07 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2013-06-18 12:31:07 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2013-06-18 12:31:08 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2013-06-18 12:31:08 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2013-06-18 12:31:08 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2013-06-18 12:31:08 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2013-06-18 12:31:08 [INFO    ] All xbars set
2013-06-18 12:31:08 [INFO    ] Setting adder chain routing for all beams
2013-06-18 12:31:13 [INFO    ] Setting beam ids
2013-06-18 12:31:23 [INFO    ] Starting beam delay calibration
2013-06-18 12:31:35 [INFO    ] Beam 1 latency is 5723
2013-06-18 12:31:35 [INFO    ] Beam 2 latency is 5766
2013-06-18 12:31:35 [INFO    ] Beam 3 latency is 5746
2013-06-18 12:31:35 [INFO    ] Beam 4 latency is 5737
2013-06-18 12:31:35 [INFO    ] Stop calibration
2013-06-18 12:31:43 [INFO    ] Beam delay calibration successful
2013-06-18 12:31:43 [INFO    ] Calibration passed
2013-06-18 12:31:43 [DEBUG   ] spawn_process: at 2013-06-18 12:31:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2013-06-18 12:31:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2013-06-18 12:31:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2013-06-18 12:31:43 [DEBUG   ] spawn_process: at 2013-06-18 12:31:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2013-06-18 12:31:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2013-06-18 12:31:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2013-06-18 12:31:43 [DEBUG   ] spawn_process: at 2013-06-18 12:31:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2013-06-18 12:31:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2013-06-18 12:31:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2013-06-18 12:31:43 [DEBUG   ] spawn_process: at 2013-06-18 12:31:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2013-06-18 12:31:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2013-06-18 12:31:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2013-06-18 12:31:43 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -5 msec
2013-06-18 12:31:44 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 104 ms (1371558704.108 s) with PID 1198 and time 1371558703
2013-06-18 12:31:44 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -4 msec
2013-06-18 12:31:44 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 194 ms (1371558704.199 s) with PID 1201 and time 1371558703
2013-06-18 12:31:45 [INFO    ] Started antennas statistics background thread
2013-06-18 12:31:45 [INFO    ] Started board flags background thread
2013-06-18 12:31:45 [INFO    ] Started BAM background thread
2013-06-18 12:31:45 [DEBUG   ] Finished updating ant stats in 1.073 seconds
2013-06-18 12:31:45 [INFO    ] Finished the INI process (ref. #7842) in 104.916 s
2013-06-18 12:31:46 [DEBUG   ] Finished updating board flags in 1.231 seconds
2013-06-18 12:32:05 [DEBUG   ] Finished updating ant stats in 0.980 seconds
2013-06-18 12:32:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:32:40 [DEBUG   ] Got command RPT from MCS: ref #7843
2013-06-18 12:32:40 [DEBUG   ] summary = NORMAL
2013-06-18 12:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7843  14 56461 45160469 A NORMALNORMAL'
2013-06-18 12:32:40 [DEBUG   ] Got command RPT from MCS: ref #7844
2013-06-18 12:32:40 [DEBUG   ] info = System calibrated and operating normally
2013-06-18 12:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7844  48 56461 45160470 A NORMALSystem calibrated and operating normally'
2013-06-18 12:32:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:32:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 12:32:46 [DEBUG   ] Finished updating board flags in 1.210 seconds
2013-06-18 12:33:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:33:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:33:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:33:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 12:33:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 12:33:46 [DEBUG   ] Finished updating board flags in 1.195 seconds
2013-06-18 12:34:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:34:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 12:34:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:34:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 12:34:47 [DEBUG   ] Finished updating board flags in 2.062 seconds
2013-06-18 12:35:00 [DEBUG   ] Got command RPT from MCS: ref #7860
2013-06-18 12:35:00 [DEBUG   ] summary = NORMAL
2013-06-18 12:35:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7860  14 56461 45300605 A NORMALNORMAL'
2013-06-18 12:35:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:35:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:35:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:35:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 12:35:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-18 12:35:47 [DEBUG   ] Finished updating board flags in 2.013 seconds
2013-06-18 12:36:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:36:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:36:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:36:47 [DEBUG   ] Finished updating board flags in 1.946 seconds
2013-06-18 12:37:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:37:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 12:37:40 [DEBUG   ] Got command RPT from MCS: ref #7861
2013-06-18 12:37:40 [DEBUG   ] summary = NORMAL
2013-06-18 12:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7861  14 56461 45460469 A NORMALNORMAL'
2013-06-18 12:37:40 [DEBUG   ] Got command RPT from MCS: ref #7862
2013-06-18 12:37:40 [DEBUG   ] info = System calibrated and operating normally
2013-06-18 12:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7862  48 56461 45460470 A NORMALSystem calibrated and operating normally'
2013-06-18 12:37:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:37:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 12:37:47 [DEBUG   ] Finished updating board flags in 1.810 seconds
2013-06-18 12:38:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:38:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:38:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:38:47 [DEBUG   ] Finished updating board flags in 1.787 seconds
2013-06-18 12:39:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:39:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 12:39:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:39:47 [DEBUG   ] Finished updating board flags in 1.594 seconds
2013-06-18 12:40:00 [DEBUG   ] Got command TBN from MCS: ref #7878
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1371559202']
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1371559202']
2013-06-18 12:40:00 [DEBUG   ] tbn = exited with status True, code 0x00
2013-06-18 12:40:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN     7878   8 56461 45600610 A NORMAL'
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1371559202']
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1371559202']
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1371559202']
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1371559202']
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1371559202']
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1371559202']
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1371559202']
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1371559202']
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1371559202']
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1371559202']
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1371559202']
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1371559202']
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1371559202']
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1371559202']
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1371559202']
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1371559202']
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1371559202']
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1371559202']
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1371559202']
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1371559202']
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1371559202']
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1371559202']
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1371559202']
2013-06-18 12:40:00 [DEBUG   ] spawn_process: at 2013-06-18 12:40:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1371559202']
2013-06-18 12:40:00 [INFO    ] Finished spawning TBN in 0.051 s
2013-06-18 12:40:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 12:40:25 [DEBUG   ] Finished updating ant stats in 0.870 seconds
2013-06-18 12:40:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 12:40:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 12:40:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 12:40:47 [DEBUG   ] Finished updating board flags in 1.630 seconds
2013-06-18 12:41:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:41:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 12:41:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 12:41:47 [DEBUG   ] Finished updating board flags in 1.589 seconds
2013-06-18 12:42:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 12:42:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 12:42:40 [DEBUG   ] Got command RPT from MCS: ref #7879
2013-06-18 12:42:40 [DEBUG   ] summary = NORMAL
2013-06-18 12:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7879  14 56461 45760473 A NORMALNORMAL'
2013-06-18 12:42:40 [DEBUG   ] Got command RPT from MCS: ref #7880
2013-06-18 12:42:40 [DEBUG   ] info = System calibrated and operating normally
2013-06-18 12:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7880  48 56461 45760474 A NORMALSystem calibrated and operating normally'
2013-06-18 12:42:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 12:42:47 [DEBUG   ] Finished updating board flags in 1.427 seconds
2013-06-18 12:43:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 12:43:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 12:43:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 12:43:47 [DEBUG   ] Finished updating board flags in 1.554 seconds
2013-06-18 12:44:06 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-18 12:44:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 12:44:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 12:44:48 [DEBUG   ] Finished updating board flags in 2.337 seconds
2013-06-18 12:45:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 12:45:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 12:45:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 12:45:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 12:45:48 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 12:45:48 [DEBUG   ] Finished updating board flags in 2.093 seconds
2013-06-18 12:46:06 [DEBUG   ] Finished updating ant stats in 1.193 seconds
2013-06-18 12:46:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 12:46:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 12:46:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 12:46:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-18 12:46:48 [DEBUG   ] Finished updating board flags in 2.019 seconds
2013-06-18 12:47:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 12:47:26 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2013-06-18 12:47:40 [DEBUG   ] Got command RPT from MCS: ref #7896
2013-06-18 12:47:40 [DEBUG   ] summary = NORMAL
2013-06-18 12:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7896  14 56461 46060473 A NORMALNORMAL'
2013-06-18 12:47:40 [DEBUG   ] Got command RPT from MCS: ref #7897
2013-06-18 12:47:40 [DEBUG   ] info = System calibrated and operating normally
2013-06-18 12:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7897  48 56461 46060474 A NORMALSystem calibrated and operating normally'
2013-06-18 12:47:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 12:47:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-18 12:47:48 [DEBUG   ] Finished updating board flags in 1.980 seconds
2013-06-18 12:48:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 12:48:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:48:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 12:48:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 12:48:48 [DEBUG   ] Finished updating board flags in 1.819 seconds
2013-06-18 12:49:06 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-18 12:49:27 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-18 12:49:47 [DEBUG   ] Finished updating ant stats in 1.257 seconds
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-18 12:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-18 12:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-18 12:49:48 [DEBUG   ] Finished updating board flags in 1.803 seconds
2013-06-18 12:50:07 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2013-06-18 12:50:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-18 12:50:47 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-18 12:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-18 12:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-18 12:50:48 [CRITICAL] MGT underflow detected on beam(s) 1
2013-06-18 12:50:48 [DEBUG   ] Finished updating board flags in 1.811 seconds
2013-06-18 12:51:07 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2013-06-18 12:51:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 12:51:47 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2013-06-18 12:51:48 [DEBUG   ] Finished updating board flags in 1.773 seconds
2013-06-18 12:52:07 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2013-06-18 12:52:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 12:52:40 [DEBUG   ] Got command RPT from MCS: ref #7913
2013-06-18 12:52:40 [DEBUG   ] summary = ERROR
2013-06-18 12:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7913  13 56461 46360477 A  ERRORERROR'
2013-06-18 12:52:40 [DEBUG   ] Got command RPT from MCS: ref #7914
2013-06-18 12:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 12:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7914  77 56461 46360478 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 12:52:47 [DEBUG   ] Finished updating ant stats in 0.649 seconds
2013-06-18 12:52:48 [DEBUG   ] Finished updating board flags in 1.622 seconds
2013-06-18 12:53:07 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2013-06-18 12:53:28 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-18 12:53:48 [DEBUG   ] Finished updating ant stats in 1.249 seconds
2013-06-18 12:53:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 12:53:48 [DEBUG   ] Finished updating board flags in 1.648 seconds
2013-06-18 12:54:08 [DEBUG   ] Finished updating ant stats in 1.157 seconds
2013-06-18 12:54:28 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2013-06-18 12:54:48 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 12:54:48 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2013-06-18 12:54:48 [DEBUG   ] Finished updating board flags in 1.615 seconds
2013-06-18 12:55:08 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2013-06-18 12:55:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 12:55:48 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2013-06-18 12:55:48 [DEBUG   ] Finished updating board flags in 1.610 seconds
2013-06-18 12:56:08 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2013-06-18 12:56:29 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-18 12:56:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 12:56:48 [DEBUG   ] Finished updating board flags in 1.554 seconds
2013-06-18 12:56:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 12:57:09 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 12:57:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 12:57:40 [DEBUG   ] Got command RPT from MCS: ref #7930
2013-06-18 12:57:40 [DEBUG   ] summary = ERROR
2013-06-18 12:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7930  13 56461 46660477 A  ERRORERROR'
2013-06-18 12:57:40 [DEBUG   ] Got command RPT from MCS: ref #7931
2013-06-18 12:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 12:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7931  77 56461 46660478 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 12:57:49 [DEBUG   ] Finished updating ant stats in 1.245 seconds
2013-06-18 12:57:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-06-18 12:57:49 [CRITICAL] MGT underflow detected on beam(s) 1
2013-06-18 12:57:49 [DEBUG   ] Finished updating board flags in 2.443 seconds
2013-06-18 12:58:09 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2013-06-18 12:58:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 12:58:49 [DEBUG   ] Finished updating ant stats in 1.041 seconds
2013-06-18 12:58:49 [DEBUG   ] Finished updating board flags in 2.382 seconds
2013-06-18 12:59:09 [DEBUG   ] Finished updating ant stats in 0.957 seconds
2013-06-18 12:59:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 12:59:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 12:59:49 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2013-06-18 12:59:49 [DEBUG   ] Finished updating board flags in 2.223 seconds
2013-06-18 13:00:09 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2013-06-18 13:00:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 13:00:49 [DEBUG   ] Finished updating ant stats in 0.641 seconds
2013-06-18 13:00:49 [DEBUG   ] Finished updating board flags in 2.180 seconds
2013-06-18 13:01:09 [DEBUG   ] Finished updating ant stats in 0.557 seconds
2013-06-18 13:01:30 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-18 13:01:49 [DEBUG   ] Finished updating board flags in 2.008 seconds
2013-06-18 13:01:50 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 13:02:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 13:02:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 13:02:40 [DEBUG   ] Got command RPT from MCS: ref #7947
2013-06-18 13:02:40 [DEBUG   ] summary = ERROR
2013-06-18 13:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7947  13 56461 46960481 A  ERRORERROR'
2013-06-18 13:02:40 [DEBUG   ] Got command RPT from MCS: ref #7948
2013-06-18 13:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 13:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7948  77 56461 46960482 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 13:02:49 [DEBUG   ] Finished updating board flags in 1.978 seconds
2013-06-18 13:02:50 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2013-06-18 13:03:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 13:03:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 13:03:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 13:03:49 [DEBUG   ] Finished updating board flags in 1.818 seconds
2013-06-18 13:03:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 13:04:10 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 13:04:30 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 13:04:49 [DEBUG   ] Finished updating board flags in 1.780 seconds
2013-06-18 13:04:50 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-18 13:05:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 13:05:30 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2013-06-18 13:05:49 [DEBUG   ] Finished updating board flags in 1.601 seconds
2013-06-18 13:05:50 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-18 13:06:11 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-18 13:06:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 13:06:49 [DEBUG   ] Finished updating board flags in 1.581 seconds
2013-06-18 13:06:51 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2013-06-18 13:07:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 13:07:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 13:07:40 [DEBUG   ] Got command RPT from MCS: ref #7964
2013-06-18 13:07:40 [DEBUG   ] summary = ERROR
2013-06-18 13:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7964  13 56461 47260473 A  ERRORERROR'
2013-06-18 13:07:40 [DEBUG   ] Got command RPT from MCS: ref #7965
2013-06-18 13:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 13:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7965  77 56461 47260474 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 13:07:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 13:07:49 [DEBUG   ] Finished updating board flags in 1.411 seconds
2013-06-18 13:07:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 13:08:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 13:08:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 13:08:49 [DEBUG   ] Finished updating board flags in 1.399 seconds
2013-06-18 13:08:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 13:09:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 13:09:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 13:09:50 [DEBUG   ] Finished updating board flags in 2.248 seconds
2013-06-18 13:09:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 13:10:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 13:10:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 13:10:50 [DEBUG   ] Finished updating board flags in 2.159 seconds
2013-06-18 13:10:51 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-06-18 13:11:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 13:11:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 13:11:50 [DEBUG   ] Finished updating board flags in 1.998 seconds
2013-06-18 13:11:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 13:12:11 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-18 13:12:32 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-18 13:12:40 [DEBUG   ] Got command RPT from MCS: ref #7981
2013-06-18 13:12:40 [DEBUG   ] summary = ERROR
2013-06-18 13:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7981  13 56461 47560477 A  ERRORERROR'
2013-06-18 13:12:40 [DEBUG   ] Got command RPT from MCS: ref #7982
2013-06-18 13:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 13:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7982  77 56461 47560478 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 13:12:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 13:12:50 [DEBUG   ] Finished updating board flags in 1.789 seconds
2013-06-18 13:12:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 13:13:12 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-18 13:13:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 13:13:50 [DEBUG   ] Finished updating board flags in 1.610 seconds
2013-06-18 13:13:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 13:14:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 13:14:32 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2013-06-18 13:14:50 [DEBUG   ] Finished updating board flags in 1.591 seconds
2013-06-18 13:14:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 13:15:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 13:15:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 13:15:50 [DEBUG   ] Finished updating board flags in 1.525 seconds
2013-06-18 13:15:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 13:16:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 13:16:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 13:16:51 [DEBUG   ] Finished updating board flags in 2.389 seconds
2013-06-18 13:16:52 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2013-06-18 13:17:12 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-18 13:17:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 13:17:40 [DEBUG   ] Got command RPT from MCS: ref #7998
2013-06-18 13:17:40 [DEBUG   ] summary = ERROR
2013-06-18 13:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7998  13 56461 47860477 A  ERRORERROR'
2013-06-18 13:17:40 [DEBUG   ] Got command RPT from MCS: ref #7999
2013-06-18 13:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 13:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     7999  77 56461 47860478 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 13:17:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 13:17:51 [DEBUG   ] Finished updating board flags in 2.149 seconds
2013-06-18 13:17:52 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2013-06-18 13:18:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 13:18:33 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-18 13:18:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-18 13:18:51 [DEBUG   ] Finished updating board flags in 1.998 seconds
2013-06-18 13:18:53 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-18 13:19:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 13:19:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 13:19:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 13:19:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-18 13:19:51 [DEBUG   ] Finished updating board flags in 1.751 seconds
2013-06-18 13:19:53 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-18 13:20:13 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-06-18 13:20:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 13:20:51 [DEBUG   ] Finished updating board flags in 1.617 seconds
2013-06-18 13:20:54 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-18 13:21:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 13:21:34 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-18 13:21:51 [DEBUG   ] Finished updating board flags in 1.582 seconds
2013-06-18 13:21:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 13:22:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 13:22:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 13:22:40 [DEBUG   ] Got command RPT from MCS: ref #8015
2013-06-18 13:22:40 [DEBUG   ] summary = ERROR
2013-06-18 13:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8015  13 56461 48160477 A  ERRORERROR'
2013-06-18 13:22:40 [DEBUG   ] Got command RPT from MCS: ref #8016
2013-06-18 13:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 13:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8016  77 56461 48160478 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 13:22:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-18 13:22:51 [DEBUG   ] Finished updating board flags in 1.420 seconds
2013-06-18 13:22:54 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2013-06-18 13:23:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 13:23:34 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 13:23:51 [DEBUG   ] Finished updating board flags in 1.395 seconds
2013-06-18 13:23:54 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 13:24:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 13:24:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 13:24:52 [DEBUG   ] Finished updating board flags in 2.200 seconds
2013-06-18 13:24:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 13:25:14 [DEBUG   ] Finished updating ant stats in 0.592 seconds
2013-06-18 13:25:34 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-18 13:25:52 [DEBUG   ] Finished updating board flags in 2.197 seconds
2013-06-18 13:25:55 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-18 13:26:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 13:26:35 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-18 13:26:52 [DEBUG   ] Finished updating board flags in 2.011 seconds
2013-06-18 13:26:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 13:27:15 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 13:27:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 13:27:40 [DEBUG   ] Got command RPT from MCS: ref #8032
2013-06-18 13:27:40 [DEBUG   ] summary = ERROR
2013-06-18 13:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8032  13 56461 48460481 A  ERRORERROR'
2013-06-18 13:27:40 [DEBUG   ] Got command RPT from MCS: ref #8033
2013-06-18 13:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 13:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8033  77 56461 48460482 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 13:27:52 [DEBUG   ] Finished updating board flags in 1.983 seconds
2013-06-18 13:27:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 13:28:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 13:28:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 13:28:52 [DEBUG   ] Finished updating board flags in 1.815 seconds
2013-06-18 13:28:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 13:29:15 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 13:29:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 13:29:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-06-18 13:29:52 [CRITICAL] MGT underflow detected on beam(s) 1
2013-06-18 13:29:52 [DEBUG   ] Finished updating board flags in 1.823 seconds
2013-06-18 13:29:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 13:30:15 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 13:30:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 13:30:52 [DEBUG   ] Finished updating board flags in 1.785 seconds
2013-06-18 13:30:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 13:31:15 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 13:31:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 13:31:52 [DEBUG   ] Finished updating board flags in 1.642 seconds
2013-06-18 13:31:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 13:32:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 13:32:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 13:32:40 [DEBUG   ] Got command RPT from MCS: ref #8049
2013-06-18 13:32:40 [DEBUG   ] summary = ERROR
2013-06-18 13:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8049  13 56461 48760485 A  ERRORERROR'
2013-06-18 13:32:40 [DEBUG   ] Got command RPT from MCS: ref #8050
2013-06-18 13:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 13:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8050  77 56461 48760486 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 13:32:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 13:32:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 13:32:52 [DEBUG   ] Finished updating board flags in 1.671 seconds
2013-06-18 13:32:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 13:33:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 13:33:35 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2013-06-18 13:33:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 13:33:52 [DEBUG   ] Finished updating board flags in 1.480 seconds
2013-06-18 13:33:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 13:34:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 13:34:35 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-18 13:34:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-18 13:34:53 [DEBUG   ] Finished updating board flags in 2.421 seconds
2013-06-18 13:34:56 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-18 13:35:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 13:35:36 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-18 13:35:52 [DEBUG   ] Finished updating board flags in 1.383 seconds
2013-06-18 13:35:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 13:36:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 13:36:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 13:36:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 13:36:53 [DEBUG   ] Finished updating board flags in 2.213 seconds
2013-06-18 13:36:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 13:37:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 13:37:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 13:37:40 [DEBUG   ] Got command RPT from MCS: ref #8066
2013-06-18 13:37:40 [DEBUG   ] summary = ERROR
2013-06-18 13:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8066  13 56461 49060478 A  ERRORERROR'
2013-06-18 13:37:40 [DEBUG   ] Got command RPT from MCS: ref #8067
2013-06-18 13:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 13:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8067  77 56461 49060478 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 13:37:53 [DEBUG   ] Finished updating board flags in 2.192 seconds
2013-06-18 13:37:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 13:38:16 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2013-06-18 13:38:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 13:38:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 13:38:53 [DEBUG   ] Finished updating board flags in 2.016 seconds
2013-06-18 13:38:56 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 13:39:16 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 13:39:36 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 13:39:53 [DEBUG   ] Finished updating board flags in 1.992 seconds
2013-06-18 13:39:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 13:40:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 13:40:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-18 13:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-18 13:40:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-18 13:40:53 [DEBUG   ] Finished updating board flags in 1.828 seconds
2013-06-18 13:40:56 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-06-18 13:41:17 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-18 13:41:37 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-18 13:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-18 13:41:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-18 13:41:53 [DEBUG   ] Finished updating board flags in 1.782 seconds
2013-06-18 13:41:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 13:42:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 13:42:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 13:42:40 [DEBUG   ] Got command RPT from MCS: ref #8083
2013-06-18 13:42:40 [DEBUG   ] summary = ERROR
2013-06-18 13:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8083  13 56461 49360478 A  ERRORERROR'
2013-06-18 13:42:40 [DEBUG   ] Got command RPT from MCS: ref #8084
2013-06-18 13:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 13:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8084  77 56461 49360478 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 13:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 13:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 13:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 13:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 13:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 13:42:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 13:42:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 13:42:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 13:42:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 13:42:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 13:42:53 [DEBUG   ] Finished updating board flags in 1.606 seconds
2013-06-18 13:42:57 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 13:43:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 13:43:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 13:43:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 13:43:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 13:43:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 13:43:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 13:43:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 13:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 13:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 13:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 13:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 13:43:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 13:43:53 [DEBUG   ] Finished updating board flags in 1.606 seconds
2013-06-18 13:43:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 13:44:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 13:44:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 13:44:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 13:44:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 13:44:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 13:44:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 13:44:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 13:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 13:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 13:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 13:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 13:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 13:44:53 [DEBUG   ] Finished updating board flags in 1.595 seconds
2013-06-18 13:44:57 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 13:45:18 [DEBUG   ] Finished updating ant stats in 1.600 seconds
2013-06-18 13:45:38 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-18 13:45:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 13:45:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 13:45:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 13:45:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 13:45:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 13:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 13:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 13:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 13:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 13:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 13:45:53 [DEBUG   ] Finished updating board flags in 1.410 seconds
2013-06-18 13:45:58 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-18 13:46:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 13:46:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 13:46:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 13:46:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 13:46:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 13:46:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 13:46:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 13:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 13:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 13:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 13:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 13:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 13:46:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 13:46:53 [DEBUG   ] Finished updating board flags in 1.385 seconds
2013-06-18 13:46:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 13:47:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 13:47:38 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 13:47:40 [DEBUG   ] Got command RPT from MCS: ref #8100
2013-06-18 13:47:40 [DEBUG   ] summary = ERROR
2013-06-18 13:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8100  13 56461 49660485 A  ERRORERROR'
2013-06-18 13:47:40 [DEBUG   ] Got command RPT from MCS: ref #8101
2013-06-18 13:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 13:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8101  77 56461 49660486 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 13:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 13:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 13:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 13:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 13:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 13:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 13:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 13:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 13:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 13:47:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 13:47:54 [DEBUG   ] Finished updating board flags in 2.224 seconds
2013-06-18 13:47:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 13:48:18 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2013-06-18 13:48:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 13:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 13:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 13:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 13:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 13:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 13:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 13:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 13:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 13:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 13:48:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 13:48:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 13:48:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-18 13:48:54 [DEBUG   ] Finished updating board flags in 2.177 seconds
2013-06-18 13:48:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 13:49:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 13:49:38 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 13:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 13:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 13:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 13:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 13:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 13:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 13:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 13:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 13:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 13:49:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 13:49:54 [DEBUG   ] Finished updating board flags in 2.016 seconds
2013-06-18 13:49:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 13:50:18 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 13:50:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 13:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 13:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 13:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 13:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 13:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 13:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 13:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 13:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 13:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 13:50:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 13:50:54 [DEBUG   ] Finished updating board flags in 2.004 seconds
2013-06-18 13:50:58 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-18 13:51:19 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-18 13:51:39 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 13:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 13:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 13:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 13:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 13:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 13:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 13:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 13:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 13:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 13:51:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 13:51:54 [DEBUG   ] Finished updating board flags in 1.989 seconds
2013-06-18 13:51:59 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-18 13:52:19 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 13:52:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 13:52:40 [DEBUG   ] Got command RPT from MCS: ref #8117
2013-06-18 13:52:40 [DEBUG   ] summary = ERROR
2013-06-18 13:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8117  13 56461 49960481 A  ERRORERROR'
2013-06-18 13:52:40 [DEBUG   ] Got command RPT from MCS: ref #8118
2013-06-18 13:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 13:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8118  77 56461 49960482 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 13:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 13:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 13:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 13:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 13:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 13:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 13:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 13:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 13:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 13:52:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 13:52:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 13:52:54 [DEBUG   ] Finished updating board flags in 1.816 seconds
2013-06-18 13:52:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 13:53:19 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-18 13:53:39 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 13:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 13:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 13:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 13:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 13:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 13:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 13:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 13:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 13:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 13:53:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 13:53:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 13:53:54 [DEBUG   ] Finished updating board flags in 1.782 seconds
2013-06-18 13:53:59 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2013-06-18 13:54:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 13:54:39 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-18 13:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 13:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 13:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 13:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 13:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 13:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 13:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 13:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 13:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 13:54:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 13:54:54 [DEBUG   ] Finished updating board flags in 1.615 seconds
2013-06-18 13:54:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 13:55:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 13:55:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 13:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 13:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 13:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 13:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 13:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 13:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 13:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 13:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 13:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 13:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 13:55:54 [DEBUG   ] Finished updating board flags in 1.593 seconds
2013-06-18 13:55:59 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 13:56:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 13:56:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 13:56:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 13:56:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 13:56:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 13:56:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 13:56:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 13:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 13:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 13:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 13:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 13:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 13:56:54 [DEBUG   ] Finished updating board flags in 1.444 seconds
2013-06-18 13:56:59 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-18 13:57:19 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-18 13:57:40 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-18 13:57:40 [DEBUG   ] Got command RPT from MCS: ref #8134
2013-06-18 13:57:40 [DEBUG   ] summary = ERROR
2013-06-18 13:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8134  13 56461 50260489 A  ERRORERROR'
2013-06-18 13:57:40 [DEBUG   ] Got command RPT from MCS: ref #8135
2013-06-18 13:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 13:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8135  77 56461 50260490 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 13:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 13:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 13:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 13:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 13:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 13:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 13:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 13:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 13:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 13:57:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 13:57:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 13:57:55 [DEBUG   ] Finished updating board flags in 2.400 seconds
2013-06-18 13:58:00 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-18 13:58:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 13:58:40 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 13:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 13:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 13:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 13:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 13:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 13:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 13:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 13:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 13:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 13:58:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 13:58:55 [DEBUG   ] Finished updating board flags in 2.166 seconds
2013-06-18 13:59:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 13:59:20 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-18 13:59:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 13:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 13:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 13:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 13:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 13:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 13:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 13:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 13:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 13:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 13:59:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 13:59:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 13:59:55 [DEBUG   ] Finished updating board flags in 2.024 seconds
2013-06-18 14:00:00 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2013-06-18 14:00:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 14:00:40 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 14:00:46 [DEBUG   ] Got command TBN from MCS: ref #8151
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1371564047']
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1371564047']
2013-06-18 14:00:46 [DEBUG   ] tbn = exited with status True, code 0x00
2013-06-18 14:00:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN     8151   8 56461 50446422 A  ERROR'
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1371564047']
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1371564047']
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1371564047']
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1371564047']
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1371564047']
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1371564047']
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1371564047']
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1371564047']
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1371564047']
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1371564047']
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1371564047']
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1371564047']
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1371564047']
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1371564047']
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1371564047']
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1371564047']
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1371564047']
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1371564047']
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1371564047']
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1371564047']
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1371564047']
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1371564047']
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1371564047']
2013-06-18 14:00:46 [DEBUG   ] spawn_process: at 2013-06-18 14:00:46 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1371564047']
2013-06-18 14:00:46 [INFO    ] Finished spawning TBN in 0.052 s
2013-06-18 14:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 14:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 14:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 14:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 14:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 14:00:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 14:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 14:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 14:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 14:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 14:00:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 14:00:55 [DEBUG   ] Finished updating board flags in 1.985 seconds
2013-06-18 14:01:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 14:01:20 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 14:01:40 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 14:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 14:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 14:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 14:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 14:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 14:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 14:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 14:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 14:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 14:01:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 14:01:55 [DEBUG   ] Finished updating board flags in 1.881 seconds
2013-06-18 14:02:00 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-18 14:02:21 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-18 14:02:40 [DEBUG   ] Got command RPT from MCS: ref #8152
2013-06-18 14:02:40 [DEBUG   ] summary = ERROR
2013-06-18 14:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8152  13 56461 50560489 A  ERRORERROR'
2013-06-18 14:02:40 [DEBUG   ] Got command RPT from MCS: ref #8153
2013-06-18 14:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 14:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8153  77 56461 50560490 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 14:02:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 14:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 14:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 14:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 14:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 14:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 14:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 14:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 14:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 14:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 14:02:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 14:02:55 [DEBUG   ] Finished updating board flags in 1.720 seconds
2013-06-18 14:03:01 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-18 14:03:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 14:03:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 14:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 14:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 14:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 14:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 14:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 14:03:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 14:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 14:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 14:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 14:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 14:03:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 14:03:55 [DEBUG   ] Finished updating board flags in 1.625 seconds
2013-06-18 14:04:01 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 14:04:21 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 14:04:41 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2013-06-18 14:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 14:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 14:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 14:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 14:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 14:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 14:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 14:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 14:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 14:04:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 14:04:55 [DEBUG   ] Finished updating board flags in 1.581 seconds
2013-06-18 14:05:01 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 14:05:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 14:05:41 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2013-06-18 14:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 14:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 14:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 14:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 14:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 14:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 14:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 14:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 14:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 14:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 14:05:55 [DEBUG   ] Finished updating board flags in 1.413 seconds
2013-06-18 14:06:01 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 14:06:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 14:06:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 14:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 14:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 14:06:55 [DEBUG   ] Finished updating board flags in 1.391 seconds
2013-06-18 14:07:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 14:07:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 14:07:40 [DEBUG   ] Got command RPT from MCS: ref #8169
2013-06-18 14:07:40 [DEBUG   ] summary = ERROR
2013-06-18 14:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8169  13 56461 50860493 A  ERRORERROR'
2013-06-18 14:07:40 [DEBUG   ] Got command RPT from MCS: ref #8170
2013-06-18 14:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 14:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8170  77 56461 50860494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 14:07:41 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 14:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 14:07:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 14:07:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 14:07:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 14:07:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 14:07:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 14:07:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 14:07:56 [DEBUG   ] Finished updating board flags in 2.230 seconds
2013-06-18 14:08:01 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 14:08:21 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2013-06-18 14:08:42 [DEBUG   ] Finished updating ant stats in 1.260 seconds
2013-06-18 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 14:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 14:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 14:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 14:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 14:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 14:08:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 14:08:56 [DEBUG   ] Finished updating board flags in 2.167 seconds
2013-06-18 14:09:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 14:09:22 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-18 14:09:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 14:09:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-18 14:09:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-18 14:09:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-18 14:09:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-18 14:09:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-18 14:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-18 14:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-18 14:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-18 14:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-18 14:09:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-18 14:09:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 14:09:56 [DEBUG   ] Finished updating board flags in 2.015 seconds
2013-06-18 14:10:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 14:10:22 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 14:10:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-18 14:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-18 14:10:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-18 14:10:56 [DEBUG   ] Finished updating board flags in 2.001 seconds
2013-06-18 14:11:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 14:11:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 14:11:42 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-18 14:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-18 14:11:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-18 14:11:56 [DEBUG   ] Finished updating board flags in 2.043 seconds
2013-06-18 14:12:02 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 14:12:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 14:12:40 [DEBUG   ] Got command RPT from MCS: ref #8186
2013-06-18 14:12:40 [DEBUG   ] summary = ERROR
2013-06-18 14:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8186  13 56461 51160489 A  ERRORERROR'
2013-06-18 14:12:40 [DEBUG   ] Got command RPT from MCS: ref #8187
2013-06-18 14:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 14:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8187  77 56461 51160490 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 14:12:42 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 14:12:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-18 14:12:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-18 14:12:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-18 14:12:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-18 14:12:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-18 14:12:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-18 14:12:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-18 14:12:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-18 14:12:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-18 14:12:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-18 14:12:56 [DEBUG   ] Finished updating board flags in 1.948 seconds
2013-06-18 14:13:02 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 14:13:23 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-06-18 14:13:43 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-18 14:13:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-18 14:13:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-18 14:13:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-18 14:13:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-18 14:13:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-18 14:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-18 14:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-18 14:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-18 14:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-18 14:13:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-18 14:13:56 [DEBUG   ] Finished updating board flags in 1.822 seconds
2013-06-18 14:14:03 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 14:14:23 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-18 14:14:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 14:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-18 14:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-18 14:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-18 14:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-18 14:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-18 14:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-18 14:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-18 14:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-18 14:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-18 14:14:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-18 14:14:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 14:14:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 14:14:56 [DEBUG   ] Finished updating board flags in 1.781 seconds
2013-06-18 14:15:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 14:15:23 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2013-06-18 14:15:43 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-18 14:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-18 14:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-18 14:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-18 14:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-18 14:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-18 14:15:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-18 14:15:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-18 14:15:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-18 14:15:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-18 14:15:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-18 14:15:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 14:15:56 [DEBUG   ] Finished updating board flags in 1.614 seconds
2013-06-18 14:16:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 14:16:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 14:16:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 14:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-18 14:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-18 14:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-18 14:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-18 14:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-18 14:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-18 14:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-18 14:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-18 14:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-18 14:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-18 14:16:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 14:16:56 [DEBUG   ] Finished updating board flags in 1.592 seconds
2013-06-18 14:17:03 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 14:17:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 14:17:40 [DEBUG   ] Got command RPT from MCS: ref #8203
2013-06-18 14:17:40 [DEBUG   ] summary = ERROR
2013-06-18 14:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8203  13 56461 51460489 A  ERRORERROR'
2013-06-18 14:17:40 [DEBUG   ] Got command RPT from MCS: ref #8204
2013-06-18 14:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 14:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8204  77 56461 51460490 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 14:17:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-18 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-18 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-18 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-18 14:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-18 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-18 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-18 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-18 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-18 14:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-18 14:17:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 14:17:56 [DEBUG   ] Finished updating board flags in 1.450 seconds
2013-06-18 14:18:04 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-06-18 14:18:24 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-18 14:18:44 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-18 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-18 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-18 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-18 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-18 14:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-18 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-18 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-18 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-18 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-18 14:18:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-18 14:18:57 [DEBUG   ] Finished updating board flags in 2.383 seconds
2013-06-18 14:19:04 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-18 14:19:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 14:19:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 14:19:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-18 14:19:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-18 14:19:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-18 14:19:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-18 14:19:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-18 14:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-18 14:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-18 14:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-18 14:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-18 14:19:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-18 14:19:57 [DEBUG   ] Finished updating board flags in 2.178 seconds
2013-06-18 14:20:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 14:20:24 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-18 14:20:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 14:20:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-18 14:20:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-18 14:20:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-18 14:20:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-18 14:20:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-18 14:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-18 14:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-18 14:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-18 14:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-18 14:20:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-18 14:20:57 [DEBUG   ] Finished updating board flags in 2.015 seconds
2013-06-18 14:21:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 14:21:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 14:21:44 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 14:21:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-18 14:21:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-18 14:21:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-18 14:21:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-18 14:21:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-18 14:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-18 14:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-18 14:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-18 14:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-18 14:21:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-18 14:21:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 14:21:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 14:21:57 [DEBUG   ] Finished updating board flags in 1.983 seconds
2013-06-18 14:22:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 14:22:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 14:22:40 [DEBUG   ] Got command RPT from MCS: ref #8220
2013-06-18 14:22:40 [DEBUG   ] summary = ERROR
2013-06-18 14:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8220  13 56461 51760489 A  ERRORERROR'
2013-06-18 14:22:40 [DEBUG   ] Got command RPT from MCS: ref #8221
2013-06-18 14:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 14:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8221  77 56461 51760490 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 14:22:44 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 14:22:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-18 14:22:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-18 14:22:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-18 14:22:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-18 14:22:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-18 14:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-18 14:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-18 14:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-18 14:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-18 14:22:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-18 14:22:57 [DEBUG   ] Finished updating board flags in 1.829 seconds
2013-06-18 14:23:05 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-06-18 14:23:25 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-18 14:23:45 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-18 14:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-18 14:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-18 14:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-18 14:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-18 14:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-18 14:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-18 14:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-18 14:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-18 14:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-18 14:23:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-18 14:23:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 14:23:57 [DEBUG   ] Finished updating board flags in 1.777 seconds
2013-06-18 14:24:05 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-18 14:24:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 14:24:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 14:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-18 14:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-18 14:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-18 14:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-18 14:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-18 14:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-18 14:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-18 14:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-18 14:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-18 14:24:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-18 14:24:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-18 14:24:57 [DEBUG   ] Finished updating board flags in 1.617 seconds
2013-06-18 14:25:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 14:25:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 14:25:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 14:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-18 14:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-18 14:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-18 14:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-18 14:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-18 14:25:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-18 14:25:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-18 14:25:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-18 14:25:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-18 14:25:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-18 14:25:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 14:25:57 [DEBUG   ] Finished updating board flags in 1.593 seconds
2013-06-18 14:26:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 14:26:25 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 14:26:45 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-18 14:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-18 14:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-18 14:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-18 14:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-18 14:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-18 14:26:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-18 14:26:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-18 14:26:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-18 14:26:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-18 14:26:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-18 14:26:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 14:26:57 [DEBUG   ] Finished updating board flags in 1.407 seconds
2013-06-18 14:27:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 14:27:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 14:27:40 [DEBUG   ] Got command RPT from MCS: ref #8237
2013-06-18 14:27:40 [DEBUG   ] summary = ERROR
2013-06-18 14:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8237  13 56461 52060493 A  ERRORERROR'
2013-06-18 14:27:40 [DEBUG   ] Got command RPT from MCS: ref #8238
2013-06-18 14:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 14:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8238  77 56461 52060494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 14:27:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 14:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-18 14:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-18 14:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-18 14:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-18 14:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-18 14:27:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-18 14:27:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-18 14:27:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-18 14:27:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-18 14:27:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-18 14:27:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 14:27:57 [DEBUG   ] Finished updating board flags in 1.395 seconds
2013-06-18 14:28:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 14:28:25 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 14:28:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 14:28:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-18 14:28:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-18 14:28:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-18 14:28:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-18 14:28:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-18 14:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-18 14:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-18 14:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-18 14:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-18 14:28:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-18 14:28:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 14:28:58 [DEBUG   ] Finished updating board flags in 2.212 seconds
2013-06-18 14:29:05 [DEBUG   ] Finished updating ant stats in 0.607 seconds
2013-06-18 14:29:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 14:29:45 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2013-06-18 14:29:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-18 14:29:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-18 14:29:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-18 14:29:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-18 14:29:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-18 14:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-18 14:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-18 14:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-18 14:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-18 14:29:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-18 14:29:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 14:29:58 [DEBUG   ] Finished updating board flags in 2.197 seconds
2013-06-18 14:30:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 14:30:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 14:30:46 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-18 14:30:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-18 14:30:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-18 14:30:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-18 14:30:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-18 14:30:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-18 14:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-18 14:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-18 14:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-18 14:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-18 14:30:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-18 14:30:58 [DEBUG   ] Finished updating board flags in 2.012 seconds
2013-06-18 14:31:05 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-18 14:31:26 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-18 14:31:46 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-18 14:31:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999607
2013-06-18 14:31:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999607
2013-06-18 14:31:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999607
2013-06-18 14:31:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999607
2013-06-18 14:31:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999607
2013-06-18 14:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999607
2013-06-18 14:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999607
2013-06-18 14:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999607
2013-06-18 14:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999607
2013-06-18 14:31:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999607
2013-06-18 14:31:58 [DEBUG   ] Finished updating board flags in 1.976 seconds
2013-06-18 14:32:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 14:32:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 14:32:40 [DEBUG   ] Got command RPT from MCS: ref #8254
2013-06-18 14:32:40 [DEBUG   ] summary = ERROR
2013-06-18 14:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8254  13 56461 52360489 A  ERRORERROR'
2013-06-18 14:32:40 [DEBUG   ] Got command RPT from MCS: ref #8255
2013-06-18 14:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 14:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8255  77 56461 52360490 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 14:32:46 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-18 14:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-18 14:32:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-18 14:32:58 [DEBUG   ] Finished updating board flags in 1.837 seconds
2013-06-18 14:33:06 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-18 14:33:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 14:33:46 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-18 14:33:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-18 14:33:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 14:33:58 [DEBUG   ] Finished updating board flags in 1.775 seconds
2013-06-18 14:34:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 14:34:26 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-18 14:34:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 14:34:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:34:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:34:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:34:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:34:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:34:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:34:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 14:34:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-18 14:34:58 [DEBUG   ] Finished updating board flags in 1.610 seconds
2013-06-18 14:35:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 14:35:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 14:35:46 [DEBUG   ] Finished updating ant stats in 0.445 seconds
2013-06-18 14:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:35:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:35:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 14:35:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 14:35:58 [DEBUG   ] Finished updating board flags in 1.583 seconds
2013-06-18 14:36:06 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-06-18 14:36:26 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-18 14:36:47 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-18 14:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:36:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:36:58 [DEBUG   ] Finished updating board flags in 1.419 seconds
2013-06-18 14:37:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 14:37:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 14:37:40 [DEBUG   ] Got command RPT from MCS: ref #8271
2013-06-18 14:37:40 [DEBUG   ] summary = ERROR
2013-06-18 14:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8271  13 56461 52660493 A  ERRORERROR'
2013-06-18 14:37:40 [DEBUG   ] Got command RPT from MCS: ref #8272
2013-06-18 14:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 14:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8272  77 56461 52660494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 14:37:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 14:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:37:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:37:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:37:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:37:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:37:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:37:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 14:37:58 [DEBUG   ] Finished updating board flags in 1.388 seconds
2013-06-18 14:38:07 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-18 14:38:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 14:38:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 14:38:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:38:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:38:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:38:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:38:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:38:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:38:59 [DEBUG   ] Finished updating board flags in 2.245 seconds
2013-06-18 14:39:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 14:39:28 [DEBUG   ] Finished updating ant stats in 1.800 seconds
2013-06-18 14:39:47 [DEBUG   ] Finished updating ant stats in 0.609 seconds
2013-06-18 14:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:39:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:39:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 14:39:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 14:39:59 [DEBUG   ] Finished updating board flags in 2.173 seconds
2013-06-18 14:40:07 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2013-06-18 14:40:27 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-18 14:40:48 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-18 14:40:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:40:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:40:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:40:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:40:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:40:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:40:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 14:40:59 [DEBUG   ] Finished updating board flags in 1.993 seconds
2013-06-18 14:41:08 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-18 14:41:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 14:41:48 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-18 14:41:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:41:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:41:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:41:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:41:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:41:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:41:59 [DEBUG   ] Finished updating board flags in 1.810 seconds
2013-06-18 14:42:08 [DEBUG   ] Finished updating ant stats in 1.192 seconds
2013-06-18 14:42:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 14:42:40 [DEBUG   ] Got command RPT from MCS: ref #8288
2013-06-18 14:42:40 [DEBUG   ] summary = ERROR
2013-06-18 14:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8288  13 56461 52960490 A  ERRORERROR'
2013-06-18 14:42:40 [DEBUG   ] Got command RPT from MCS: ref #8289
2013-06-18 14:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 14:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8289  77 56461 52960490 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 14:42:48 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-18 14:42:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:42:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:42:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:42:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:42:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:42:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:42:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 14:42:59 [DEBUG   ] Finished updating board flags in 1.793 seconds
2013-06-18 14:43:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 14:43:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 14:43:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 14:43:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:43:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:43:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:43:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:43:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:43:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 14:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:43:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:43:59 [DEBUG   ] Finished updating board flags in 1.610 seconds
2013-06-18 14:44:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 14:44:28 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-18 14:44:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 14:44:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:44:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:44:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:44:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:44:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:44:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 14:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:44:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:44:59 [DEBUG   ] Finished updating board flags in 1.643 seconds
2013-06-18 14:45:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 14:45:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 14:45:48 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 14:45:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:45:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:45:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:45:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:45:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:45:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:45:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 14:45:59 [DEBUG   ] Finished updating board flags in 1.559 seconds
2013-06-18 14:46:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 14:46:28 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-18 14:46:49 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-18 14:46:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:46:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:46:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:46:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:46:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:46:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:46:59 [DEBUG   ] Finished updating board flags in 1.397 seconds
2013-06-18 14:47:09 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 14:47:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 14:47:40 [DEBUG   ] Got command RPT from MCS: ref #8305
2013-06-18 14:47:40 [DEBUG   ] summary = ERROR
2013-06-18 14:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8305  13 56461 53260493 A  ERRORERROR'
2013-06-18 14:47:40 [DEBUG   ] Got command RPT from MCS: ref #8306
2013-06-18 14:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 14:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8306  77 56461 53260494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 14:47:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 14:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:47:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:47:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 14:48:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:48:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:48:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:48:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:48:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:48:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 14:48:00 [DEBUG   ] Finished updating board flags in 2.211 seconds
2013-06-18 14:48:09 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-18 14:48:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 14:48:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 14:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:48:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:49:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:49:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 14:49:00 [DEBUG   ] Finished updating board flags in 2.183 seconds
2013-06-18 14:49:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 14:49:29 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-18 14:49:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 14:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:49:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:50:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:50:00 [DEBUG   ] Finished updating board flags in 2.025 seconds
2013-06-18 14:50:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 14:50:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 14:50:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 14:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:50:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:51:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:51:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 14:51:00 [DEBUG   ] Finished updating board flags in 1.991 seconds
2013-06-18 14:51:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 14:51:30 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-18 14:51:50 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-18 14:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:51:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:52:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:52:00 [DEBUG   ] Finished updating board flags in 1.803 seconds
2013-06-18 14:52:10 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2013-06-18 14:52:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 14:52:40 [DEBUG   ] Got command RPT from MCS: ref #8322
2013-06-18 14:52:40 [DEBUG   ] summary = ERROR
2013-06-18 14:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8322  13 56461 53560501 A  ERRORERROR'
2013-06-18 14:52:40 [DEBUG   ] Got command RPT from MCS: ref #8323
2013-06-18 14:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 14:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8323  77 56461 53560502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 14:52:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 14:52:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:52:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:52:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:52:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:52:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:53:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:53:00 [DEBUG   ] Finished updating board flags in 1.807 seconds
2013-06-18 14:53:10 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-18 14:53:30 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 14:53:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 14:53:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:53:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:53:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:53:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:53:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:54:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:54:00 [DEBUG   ] Finished updating board flags in 1.790 seconds
2013-06-18 14:54:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 14:54:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 14:54:50 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 14:54:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:54:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:54:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:54:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:54:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:55:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:55:00 [DEBUG   ] Finished updating board flags in 1.674 seconds
2013-06-18 14:55:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 14:55:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 14:55:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 14:55:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:55:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:55:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:55:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:55:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:56:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:56:00 [DEBUG   ] Finished updating board flags in 1.528 seconds
2013-06-18 14:56:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 14:56:31 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-18 14:56:50 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-18 14:56:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:56:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:56:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:56:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:56:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:57:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:57:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 14:57:00 [DEBUG   ] Finished updating board flags in 1.410 seconds
2013-06-18 14:57:11 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-18 14:57:31 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-18 14:57:40 [DEBUG   ] Got command RPT from MCS: ref #8339
2013-06-18 14:57:40 [DEBUG   ] summary = ERROR
2013-06-18 14:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8339  13 56461 53860493 A  ERRORERROR'
2013-06-18 14:57:40 [DEBUG   ] Got command RPT from MCS: ref #8340
2013-06-18 14:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 14:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8340  77 56461 53860494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 14:57:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 14:57:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-18 14:57:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-18 14:57:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-18 14:57:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-18 14:57:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-18 14:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-18 14:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-18 14:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-18 14:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-18 14:58:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-18 14:58:00 [DEBUG   ] Finished updating board flags in 1.390 seconds
2013-06-18 14:58:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 14:58:31 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-18 14:58:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-18 14:59:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-18 14:59:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 14:59:01 [DEBUG   ] Finished updating board flags in 2.234 seconds
2013-06-18 14:59:11 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-18 14:59:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 14:59:51 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-18 15:00:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-18 15:00:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-18 15:00:01 [DEBUG   ] Finished updating board flags in 2.185 seconds
2013-06-18 15:00:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 15:00:31 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-18 15:00:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 15:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:01:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:01:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:01:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:01:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:01:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:01:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:01:01 [DEBUG   ] Finished updating board flags in 2.004 seconds
2013-06-18 15:01:11 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-18 15:01:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 15:01:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 15:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:02:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:02:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:02:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:02:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:02:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:02:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:02:01 [DEBUG   ] Finished updating board flags in 2.013 seconds
2013-06-18 15:02:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 15:02:31 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-18 15:02:40 [DEBUG   ] Got command RPT from MCS: ref #8356
2013-06-18 15:02:40 [DEBUG   ] summary = ERROR
2013-06-18 15:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8356  13 56461 54160493 A  ERRORERROR'
2013-06-18 15:02:40 [DEBUG   ] Got command RPT from MCS: ref #8357
2013-06-18 15:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 15:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8357  77 56461 54160494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 15:02:51 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-18 15:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:03:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:03:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:03:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 15:03:01 [DEBUG   ] Finished updating board flags in 1.988 seconds
2013-06-18 15:03:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-18 15:03:32 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-18 15:03:52 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-18 15:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:04:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:04:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:04:01 [DEBUG   ] Finished updating board flags in 1.807 seconds
2013-06-18 15:04:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 15:04:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 15:04:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 15:05:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:05:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:05:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:05:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:05:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:05:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:05:01 [DEBUG   ] Finished updating board flags in 1.793 seconds
2013-06-18 15:05:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 15:05:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 15:05:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 15:06:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:06:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:06:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:06:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:06:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:06:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:06:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 15:06:01 [DEBUG   ] Finished updating board flags in 1.614 seconds
2013-06-18 15:06:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 15:06:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 15:06:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 15:07:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:07:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:07:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:07:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:07:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:07:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:07:01 [DEBUG   ] Finished updating board flags in 1.592 seconds
2013-06-18 15:07:12 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2013-06-18 15:07:33 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-18 15:07:40 [DEBUG   ] Got command RPT from MCS: ref #8373
2013-06-18 15:07:40 [DEBUG   ] summary = ERROR
2013-06-18 15:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8373  13 56461 54460501 A  ERRORERROR'
2013-06-18 15:07:40 [DEBUG   ] Got command RPT from MCS: ref #8374
2013-06-18 15:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 15:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8374  77 56461 54460502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 15:07:53 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 15:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:08:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:08:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 15:08:01 [DEBUG   ] Finished updating board flags in 1.405 seconds
2013-06-18 15:08:13 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2013-06-18 15:08:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 15:08:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 15:09:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:09:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:09:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:09:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:09:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:09:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:09:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 15:09:01 [DEBUG   ] Finished updating board flags in 1.395 seconds
2013-06-18 15:09:13 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 15:09:33 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 15:09:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 15:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:10:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:10:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:10:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:10:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:10:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:10:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:10:02 [DEBUG   ] Finished updating board flags in 2.210 seconds
2013-06-18 15:10:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 15:10:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 15:10:53 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 15:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:11:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:11:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:11:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:11:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:11:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:11:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:11:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 15:11:02 [DEBUG   ] Finished updating board flags in 2.214 seconds
2013-06-18 15:11:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 15:11:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 15:11:53 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 15:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:12:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:12:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:12:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:12:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:12:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:12:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:12:02 [DEBUG   ] Finished updating board flags in 2.213 seconds
2013-06-18 15:12:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 15:12:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-18 15:12:40 [DEBUG   ] Got command RPT from MCS: ref #8390
2013-06-18 15:12:40 [DEBUG   ] summary = ERROR
2013-06-18 15:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8390  13 56461 54760501 A  ERRORERROR'
2013-06-18 15:12:40 [DEBUG   ] Got command RPT from MCS: ref #8391
2013-06-18 15:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 15:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8391  77 56461 54760502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 15:12:54 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-18 15:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:13:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:13:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:13:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:13:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:13:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:13:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:13:02 [DEBUG   ] Finished updating board flags in 2.175 seconds
2013-06-18 15:13:13 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-18 15:13:34 [DEBUG   ] Finished updating ant stats in 1.389 seconds
2013-06-18 15:13:54 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 15:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:14:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:14:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:14:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:14:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:14:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:14:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:14:02 [DEBUG   ] Finished updating board flags in 2.001 seconds
2013-06-18 15:14:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 15:14:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 15:14:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 15:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:15:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:15:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:15:02 [DEBUG   ] Finished updating board flags in 2.013 seconds
2013-06-18 15:15:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 15:15:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 15:15:54 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 15:16:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:16:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:16:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:16:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:16:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:16:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:16:02 [DEBUG   ] Finished updating board flags in 2.037 seconds
2013-06-18 15:16:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 15:16:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 15:16:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 15:17:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:17:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:17:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:17:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:17:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:17:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:17:02 [DEBUG   ] Finished updating board flags in 1.959 seconds
2013-06-18 15:17:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 15:17:34 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-18 15:17:40 [DEBUG   ] Got command RPT from MCS: ref #8407
2013-06-18 15:17:40 [DEBUG   ] summary = ERROR
2013-06-18 15:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8407  13 56461 55060505 A  ERRORERROR'
2013-06-18 15:17:40 [DEBUG   ] Got command RPT from MCS: ref #8408
2013-06-18 15:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 15:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8408  77 56461 55060506 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 15:17:54 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-18 15:18:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:18:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:18:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:18:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:18:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:18:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:18:02 [DEBUG   ] Finished updating board flags in 1.802 seconds
2013-06-18 15:18:15 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-18 15:18:35 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-18 15:18:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 15:19:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:19:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:19:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:19:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:19:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:19:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:19:02 [DEBUG   ] Finished updating board flags in 1.809 seconds
2013-06-18 15:19:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 15:19:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 15:19:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 15:20:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:20:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:20:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:20:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:20:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:20:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:20:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 15:20:02 [DEBUG   ] Finished updating board flags in 1.791 seconds
2013-06-18 15:20:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 15:20:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 15:20:55 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-18 15:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:21:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:21:02 [DEBUG   ] Finished updating board flags in 1.605 seconds
2013-06-18 15:21:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 15:21:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 15:21:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 15:22:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:22:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:22:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:22:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:22:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:22:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:22:02 [DEBUG   ] Finished updating board flags in 1.599 seconds
2013-06-18 15:22:15 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-18 15:22:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 15:22:40 [DEBUG   ] Got command RPT from MCS: ref #8424
2013-06-18 15:22:40 [DEBUG   ] summary = ERROR
2013-06-18 15:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8424  13 56461 55360502 A  ERRORERROR'
2013-06-18 15:22:40 [DEBUG   ] Got command RPT from MCS: ref #8425
2013-06-18 15:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 15:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8425  77 56461 55360502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 15:22:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 15:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:23:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:23:02 [DEBUG   ] Finished updating board flags in 1.411 seconds
2013-06-18 15:23:15 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 15:23:35 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-18 15:23:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-18 15:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:24:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:24:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 15:24:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 15:24:02 [DEBUG   ] Finished updating board flags in 1.390 seconds
2013-06-18 15:24:16 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-18 15:24:36 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-18 15:24:56 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 15:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:25:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:25:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:25:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 15:25:03 [DEBUG   ] Finished updating board flags in 2.215 seconds
2013-06-18 15:25:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 15:25:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 15:25:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 15:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:26:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:26:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:26:03 [DEBUG   ] Finished updating board flags in 2.188 seconds
2013-06-18 15:26:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 15:26:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 15:26:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 15:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:27:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:27:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:27:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 15:27:03 [DEBUG   ] Finished updating board flags in 2.029 seconds
2013-06-18 15:27:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 15:27:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 15:27:40 [DEBUG   ] Got command RPT from MCS: ref #8441
2013-06-18 15:27:40 [DEBUG   ] summary = ERROR
2013-06-18 15:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8441  13 56461 55660509 A  ERRORERROR'
2013-06-18 15:27:40 [DEBUG   ] Got command RPT from MCS: ref #8442
2013-06-18 15:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 15:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8442  77 56461 55660510 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 15:27:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 15:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:28:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:28:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:28:03 [DEBUG   ] Finished updating board flags in 1.975 seconds
2013-06-18 15:28:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 15:28:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 15:28:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 15:29:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:29:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:29:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:29:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:29:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:29:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:29:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 15:29:03 [DEBUG   ] Finished updating board flags in 1.823 seconds
2013-06-18 15:29:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 15:29:36 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 15:29:57 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-18 15:30:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:30:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:30:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:30:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:30:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:30:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:30:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 15:30:03 [DEBUG   ] Finished updating board flags in 1.809 seconds
2013-06-18 15:30:17 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 15:30:37 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 15:30:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 15:31:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:31:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:31:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:31:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:31:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:31:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:31:03 [DEBUG   ] Finished updating board flags in 1.789 seconds
2013-06-18 15:31:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 15:31:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 15:31:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 15:32:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:32:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:32:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:32:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:32:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:32:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:32:03 [DEBUG   ] Finished updating board flags in 1.621 seconds
2013-06-18 15:32:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 15:32:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 15:32:40 [DEBUG   ] Got command RPT from MCS: ref #8458
2013-06-18 15:32:40 [DEBUG   ] summary = ERROR
2013-06-18 15:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8458  13 56461 55960509 A  ERRORERROR'
2013-06-18 15:32:40 [DEBUG   ] Got command RPT from MCS: ref #8459
2013-06-18 15:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 15:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8459  77 56461 55960510 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 15:32:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 15:33:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:33:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:33:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:33:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:33:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:33:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:33:03 [DEBUG   ] Finished updating board flags in 1.570 seconds
2013-06-18 15:33:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 15:33:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 15:33:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 15:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:34:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:34:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:34:03 [DEBUG   ] Finished updating board flags in 1.490 seconds
2013-06-18 15:34:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 15:34:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 15:34:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 15:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:35:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:35:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:35:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:35:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:35:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:35:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:35:04 [DEBUG   ] Finished updating board flags in 2.408 seconds
2013-06-18 15:35:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 15:35:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 15:35:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 15:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:36:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:36:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:36:04 [DEBUG   ] Finished updating board flags in 2.296 seconds
2013-06-18 15:36:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 15:36:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 15:36:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 15:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:37:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:37:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:37:04 [DEBUG   ] Finished updating board flags in 2.243 seconds
2013-06-18 15:37:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 15:37:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 15:37:40 [DEBUG   ] Got command RPT from MCS: ref #8475
2013-06-18 15:37:40 [DEBUG   ] summary = ERROR
2013-06-18 15:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8475  13 56461 56260501 A  ERRORERROR'
2013-06-18 15:37:40 [DEBUG   ] Got command RPT from MCS: ref #8476
2013-06-18 15:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 15:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8476  77 56461 56260502 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 15:37:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:38:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:38:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:38:04 [DEBUG   ] Finished updating board flags in 2.210 seconds
2013-06-18 15:38:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 15:38:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 15:38:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:39:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:39:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:39:04 [DEBUG   ] Finished updating board flags in 2.163 seconds
2013-06-18 15:39:17 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 15:39:38 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-18 15:39:58 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-18 15:40:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:40:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:40:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:40:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:40:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:40:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:40:04 [DEBUG   ] Finished updating board flags in 2.009 seconds
2013-06-18 15:40:18 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-18 15:40:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 15:40:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 15:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:41:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:41:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:41:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 15:41:04 [DEBUG   ] Finished updating board flags in 1.984 seconds
2013-06-18 15:41:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 15:41:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 15:41:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 15:42:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:42:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:42:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:42:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:42:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:42:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:42:04 [DEBUG   ] Finished updating board flags in 1.837 seconds
2013-06-18 15:42:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 15:42:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 15:42:40 [DEBUG   ] Got command RPT from MCS: ref #8492
2013-06-18 15:42:40 [DEBUG   ] summary = ERROR
2013-06-18 15:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8492  13 56461 56560509 A  ERRORERROR'
2013-06-18 15:42:40 [DEBUG   ] Got command RPT from MCS: ref #8493
2013-06-18 15:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 15:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8493  77 56461 56560510 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 15:42:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 15:43:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:43:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:43:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:43:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:43:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:43:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:43:04 [DEBUG   ] Finished updating board flags in 1.858 seconds
2013-06-18 15:43:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 15:43:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 15:43:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 15:44:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:44:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:44:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:44:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:44:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:44:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:44:04 [DEBUG   ] Finished updating board flags in 1.720 seconds
2013-06-18 15:44:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 15:44:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 15:44:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 15:45:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:45:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:45:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:45:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:45:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:45:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:45:04 [DEBUG   ] Finished updating board flags in 1.635 seconds
2013-06-18 15:45:18 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-18 15:45:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 15:45:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 15:46:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:46:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:46:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:46:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:46:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:46:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:46:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 15:46:04 [DEBUG   ] Finished updating board flags in 1.564 seconds
2013-06-18 15:46:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 15:46:38 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 15:46:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 15:47:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:47:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:47:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:47:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:47:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:47:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 15:47:04 [DEBUG   ] Finished updating board flags in 1.478 seconds
2013-06-18 15:47:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 15:47:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 15:47:40 [DEBUG   ] Got command RPT from MCS: ref #8509
2013-06-18 15:47:40 [DEBUG   ] summary = ERROR
2013-06-18 15:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8509  13 56461 56860513 A  ERRORERROR'
2013-06-18 15:47:40 [DEBUG   ] Got command RPT from MCS: ref #8510
2013-06-18 15:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 15:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8510  77 56461 56860514 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 15:47:58 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 15:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:48:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:48:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:48:05 [DEBUG   ] Finished updating board flags in 2.364 seconds
2013-06-18 15:48:18 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2013-06-18 15:48:38 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-18 15:48:59 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-18 15:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:49:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:49:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:49:05 [DEBUG   ] Finished updating board flags in 2.171 seconds
2013-06-18 15:49:19 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-18 15:49:39 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 15:49:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 15:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:50:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:50:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:50:05 [DEBUG   ] Finished updating board flags in 2.006 seconds
2013-06-18 15:50:19 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-18 15:50:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 15:50:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 15:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:51:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:51:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:51:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 15:51:05 [DEBUG   ] Finished updating board flags in 2.003 seconds
2013-06-18 15:51:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 15:51:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 15:51:59 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 15:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:52:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:52:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:52:05 [DEBUG   ] Finished updating board flags in 2.064 seconds
2013-06-18 15:52:19 [DEBUG   ] Finished updating ant stats in 0.991 seconds
2013-06-18 15:52:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 15:52:40 [DEBUG   ] Got command RPT from MCS: ref #8526
2013-06-18 15:52:40 [DEBUG   ] summary = ERROR
2013-06-18 15:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8526  13 56461 57160505 A  ERRORERROR'
2013-06-18 15:52:40 [DEBUG   ] Got command RPT from MCS: ref #8527
2013-06-18 15:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 15:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8527  77 56461 57160506 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 15:52:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 15:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:53:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:53:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:53:05 [DEBUG   ] Finished updating board flags in 1.939 seconds
2013-06-18 15:53:19 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 15:53:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 15:53:59 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-06-18 15:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:54:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:54:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:54:05 [DEBUG   ] Finished updating board flags in 1.808 seconds
2013-06-18 15:54:20 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-18 15:54:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 15:55:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 15:55:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:55:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:55:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:55:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:55:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:55:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:55:05 [DEBUG   ] Finished updating board flags in 1.792 seconds
2013-06-18 15:55:20 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-18 15:55:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 15:56:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 15:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:56:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:56:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:56:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:56:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:56:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:56:05 [DEBUG   ] Finished updating board flags in 1.620 seconds
2013-06-18 15:56:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 15:56:40 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2013-06-18 15:57:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 15:57:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:57:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:57:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:57:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:57:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:57:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:57:05 [DEBUG   ] Finished updating board flags in 1.590 seconds
2013-06-18 15:57:20 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-18 15:57:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 15:57:40 [DEBUG   ] Got command RPT from MCS: ref #8543
2013-06-18 15:57:40 [DEBUG   ] summary = ERROR
2013-06-18 15:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8543  13 56461 57460513 A  ERRORERROR'
2013-06-18 15:57:40 [DEBUG   ] Got command RPT from MCS: ref #8544
2013-06-18 15:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 15:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8544  77 56461 57460514 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 15:58:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 15:58:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:58:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:58:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:58:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:58:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:58:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:58:05 [DEBUG   ] Finished updating board flags in 1.410 seconds
2013-06-18 15:58:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 15:58:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 15:59:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 15:59:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 15:59:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 15:59:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 15:59:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 15:59:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 15:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 15:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 15:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 15:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 15:59:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 15:59:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 15:59:05 [DEBUG   ] Finished updating board flags in 1.405 seconds
2013-06-18 15:59:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 15:59:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 16:00:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 16:00:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 16:00:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 16:00:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 16:00:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 16:00:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 16:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 16:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 16:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 16:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 16:00:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 16:00:05 [DEBUG   ] Finished updating board flags in 1.391 seconds
2013-06-18 16:00:20 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2013-06-18 16:00:41 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-18 16:01:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 16:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 16:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 16:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 16:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 16:01:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 16:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 16:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 16:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 16:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 16:01:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 16:01:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 16:01:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 16:01:06 [DEBUG   ] Finished updating board flags in 2.217 seconds
2013-06-18 16:01:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 16:01:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 16:02:01 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 16:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 16:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 16:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 16:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 16:02:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 16:02:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 16:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 16:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 16:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 16:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 16:02:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 16:02:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-18 16:02:06 [DEBUG   ] Finished updating board flags in 2.207 seconds
2013-06-18 16:02:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 16:02:40 [DEBUG   ] Got command RPT from MCS: ref #8576
2013-06-18 16:02:40 [DEBUG   ] summary = ERROR
2013-06-18 16:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8576  13 56461 57760505 A  ERRORERROR'
2013-06-18 16:02:40 [DEBUG   ] Got command RPT from MCS: ref #8577
2013-06-18 16:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 16:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8577  77 56461 57760506 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 16:02:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 16:03:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 16:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 16:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 16:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 16:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 16:03:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 16:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 16:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 16:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 16:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 16:03:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 16:03:06 [DEBUG   ] Finished updating board flags in 2.175 seconds
2013-06-18 16:03:21 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 16:03:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 16:04:01 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 16:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 16:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 16:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 16:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 16:04:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 16:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 16:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 16:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 16:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 16:04:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 16:04:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 16:04:06 [DEBUG   ] Finished updating board flags in 2.026 seconds
2013-06-18 16:04:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 16:04:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 16:05:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 16:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 16:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 16:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 16:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 16:05:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 16:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 16:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 16:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 16:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 16:05:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 16:05:06 [DEBUG   ] Finished updating board flags in 2.094 seconds
2013-06-18 16:05:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 16:05:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 16:06:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 16:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 16:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 16:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 16:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 16:06:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 16:06:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 16:06:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 16:06:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 16:06:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 16:06:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 16:06:06 [DEBUG   ] Finished updating board flags in 1.904 seconds
2013-06-18 16:06:21 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-18 16:06:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 16:07:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 16:07:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 16:07:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 16:07:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 16:07:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 16:07:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 16:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 16:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 16:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 16:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 16:07:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 16:07:06 [DEBUG   ] Finished updating board flags in 1.798 seconds
2013-06-18 16:07:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 16:07:40 [DEBUG   ] Got command RPT from MCS: ref #8593
2013-06-18 16:07:40 [DEBUG   ] summary = ERROR
2013-06-18 16:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8593  13 56461 58060505 A  ERRORERROR'
2013-06-18 16:07:40 [DEBUG   ] Got command RPT from MCS: ref #8594
2013-06-18 16:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 16:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8594  77 56461 58060506 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 16:07:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 16:08:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 16:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 16:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 16:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 16:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 16:08:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 16:08:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 16:08:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 16:08:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 16:08:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 16:08:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 16:08:06 [DEBUG   ] Finished updating board flags in 1.610 seconds
2013-06-18 16:08:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 16:08:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 16:09:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 16:09:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 16:09:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 16:09:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 16:09:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 16:09:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 16:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 16:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 16:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 16:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 16:09:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 16:09:06 [DEBUG   ] Finished updating board flags in 1.597 seconds
2013-06-18 16:09:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 16:09:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 16:10:01 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 16:10:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-18 16:10:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-18 16:10:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-18 16:10:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-18 16:10:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-18 16:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-18 16:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-18 16:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-18 16:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-18 16:10:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-18 16:10:06 [DEBUG   ] Finished updating board flags in 1.393 seconds
2013-06-18 16:10:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 16:10:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 16:11:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-18 16:11:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-18 16:11:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-18 16:11:07 [DEBUG   ] Finished updating board flags in 2.221 seconds
2013-06-18 16:11:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 16:11:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 16:12:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-18 16:12:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-18 16:12:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-18 16:12:07 [DEBUG   ] Finished updating board flags in 2.282 seconds
2013-06-18 16:12:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 16:12:40 [DEBUG   ] Got command RPT from MCS: ref #8610
2013-06-18 16:12:40 [DEBUG   ] summary = ERROR
2013-06-18 16:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8610  13 56461 58360509 A  ERRORERROR'
2013-06-18 16:12:40 [DEBUG   ] Got command RPT from MCS: ref #8611
2013-06-18 16:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 16:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8611  77 56461 58360510 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 16:12:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 16:13:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 16:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:13:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:13:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 16:13:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 16:13:07 [DEBUG   ] Finished updating board flags in 2.221 seconds
2013-06-18 16:13:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 16:13:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 16:14:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 16:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:14:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:14:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 16:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:14:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:14:07 [DEBUG   ] Finished updating board flags in 2.209 seconds
2013-06-18 16:14:21 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-18 16:14:41 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-06-18 16:15:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-18 16:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:15:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:15:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:15:07 [DEBUG   ] Finished updating board flags in 2.061 seconds
2013-06-18 16:15:22 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-18 16:15:42 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-18 16:16:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 16:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:16:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:16:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:16:07 [DEBUG   ] Finished updating board flags in 2.024 seconds
2013-06-18 16:16:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 16:16:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 16:17:03 [DEBUG   ] Finished updating ant stats in 2.198 seconds
2013-06-18 16:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:17:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:17:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:17:07 [DEBUG   ] Finished updating board flags in 1.992 seconds
2013-06-18 16:17:22 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2013-06-18 16:17:40 [DEBUG   ] Got command RPT from MCS: ref #8627
2013-06-18 16:17:40 [DEBUG   ] summary = ERROR
2013-06-18 16:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8627  13 56461 58660517 A  ERRORERROR'
2013-06-18 16:17:40 [DEBUG   ] Got command RPT from MCS: ref #8628
2013-06-18 16:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 16:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8628  77 56461 58660518 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 16:17:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 16:18:02 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-18 16:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:18:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:18:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:18:07 [DEBUG   ] Finished updating board flags in 1.810 seconds
2013-06-18 16:18:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 16:18:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 16:19:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 16:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:19:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:19:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:19:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:19:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:19:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:19:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:19:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 16:19:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 16:19:07 [DEBUG   ] Finished updating board flags in 1.811 seconds
2013-06-18 16:19:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 16:19:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 16:20:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 16:20:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:20:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:20:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:20:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:20:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:20:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:20:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:20:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:20:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:20:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:20:07 [DEBUG   ] Finished updating board flags in 1.779 seconds
2013-06-18 16:20:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 16:20:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 16:21:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 16:21:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:21:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:21:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:21:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:21:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:21:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:21:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:21:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:21:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:21:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:21:07 [DEBUG   ] Finished updating board flags in 1.622 seconds
2013-06-18 16:21:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 16:21:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 16:22:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 16:22:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:22:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:22:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:22:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:22:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:22:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:22:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:22:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:22:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:22:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:22:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 16:22:07 [DEBUG   ] Finished updating board flags in 1.671 seconds
2013-06-18 16:22:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 16:22:40 [DEBUG   ] Got command RPT from MCS: ref #8644
2013-06-18 16:22:40 [DEBUG   ] summary = ERROR
2013-06-18 16:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8644  13 56461 58960510 A  ERRORERROR'
2013-06-18 16:22:40 [DEBUG   ] Got command RPT from MCS: ref #8645
2013-06-18 16:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 16:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8645  77 56461 58960510 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 16:22:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 16:23:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 16:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:23:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:23:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:23:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:23:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:23:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:23:07 [DEBUG   ] Finished updating board flags in 1.519 seconds
2013-06-18 16:23:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 16:23:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 16:24:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 16:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:24:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:24:07 [DEBUG   ] Finished updating board flags in 1.518 seconds
2013-06-18 16:24:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 16:24:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 16:25:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 16:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:25:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:25:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:25:08 [DEBUG   ] Finished updating board flags in 2.352 seconds
2013-06-18 16:25:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 16:25:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 16:26:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 16:26:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:26:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:26:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:26:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:26:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:26:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:26:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 16:26:08 [DEBUG   ] Finished updating board flags in 2.150 seconds
2013-06-18 16:26:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 16:26:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 16:27:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 16:27:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:27:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:27:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:27:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:27:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:27:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:27:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 16:27:08 [DEBUG   ] Finished updating board flags in 2.038 seconds
2013-06-18 16:27:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 16:27:40 [DEBUG   ] Got command RPT from MCS: ref #8661
2013-06-18 16:27:40 [DEBUG   ] summary = ERROR
2013-06-18 16:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8661  13 56461 59260513 A  ERRORERROR'
2013-06-18 16:27:40 [DEBUG   ] Got command RPT from MCS: ref #8662
2013-06-18 16:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 16:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8662  77 56461 59260514 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 16:27:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 16:28:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 16:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:28:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:28:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:28:08 [DEBUG   ] Finished updating board flags in 2.050 seconds
2013-06-18 16:28:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 16:28:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 16:29:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 16:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:29:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:29:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:29:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 16:29:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-18 16:29:08 [DEBUG   ] Finished updating board flags in 1.911 seconds
2013-06-18 16:29:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 16:29:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 16:30:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 16:30:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:30:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:30:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:30:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:30:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:30:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:30:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:30:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:30:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:30:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:30:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 16:30:08 [DEBUG   ] Finished updating board flags in 1.848 seconds
2013-06-18 16:30:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 16:30:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 16:31:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 16:31:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:31:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:31:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:31:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:31:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:31:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:31:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:31:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:31:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:31:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:31:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 16:31:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-18 16:31:08 [DEBUG   ] Finished updating board flags in 1.781 seconds
2013-06-18 16:31:22 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-18 16:31:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 16:32:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 16:32:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:32:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:32:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:32:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:32:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:32:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:32:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:32:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:32:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:32:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:32:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 16:32:08 [DEBUG   ] Finished updating board flags in 1.583 seconds
2013-06-18 16:32:22 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 16:32:40 [DEBUG   ] Got command RPT from MCS: ref #8678
2013-06-18 16:32:40 [DEBUG   ] summary = ERROR
2013-06-18 16:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8678  13 56461 59560517 A  ERRORERROR'
2013-06-18 16:32:40 [DEBUG   ] Got command RPT from MCS: ref #8679
2013-06-18 16:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 16:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8679  77 56461 59560518 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 16:32:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 16:33:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 16:33:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:33:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:33:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:33:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:33:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:33:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:33:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:33:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:33:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:33:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:33:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-18 16:33:08 [DEBUG   ] Finished updating board flags in 1.471 seconds
2013-06-18 16:33:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 16:33:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 16:34:02 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-18 16:34:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:34:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:34:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:34:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:34:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:34:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:34:09 [DEBUG   ] Finished updating board flags in 2.371 seconds
2013-06-18 16:34:23 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2013-06-18 16:34:43 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-18 16:35:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:35:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:35:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:35:09 [DEBUG   ] Finished updating board flags in 2.162 seconds
2013-06-18 16:35:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 16:35:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 16:36:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:36:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:36:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:36:09 [DEBUG   ] Finished updating board flags in 2.030 seconds
2013-06-18 16:36:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 16:36:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 16:37:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 16:37:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:37:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:37:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:37:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:37:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:37:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:37:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 16:37:09 [DEBUG   ] Finished updating board flags in 2.035 seconds
2013-06-18 16:37:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 16:37:40 [DEBUG   ] Got command RPT from MCS: ref #8695
2013-06-18 16:37:40 [DEBUG   ] summary = ERROR
2013-06-18 16:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8695  13 56461 59860517 A  ERRORERROR'
2013-06-18 16:37:40 [DEBUG   ] Got command RPT from MCS: ref #8696
2013-06-18 16:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 16:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8696  77 56461 59860518 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 16:37:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 16:38:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 16:38:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:38:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:38:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:38:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:38:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:38:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:38:09 [DEBUG   ] Finished updating board flags in 1.957 seconds
2013-06-18 16:38:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 16:38:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 16:39:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 16:39:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:39:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:39:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:39:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:39:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:39:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:39:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:39:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:39:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:39:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:39:09 [DEBUG   ] Finished updating board flags in 1.839 seconds
2013-06-18 16:39:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 16:39:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 16:40:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 16:40:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:40:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:40:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:40:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:40:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:40:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:40:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:40:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:40:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:40:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:40:09 [DEBUG   ] Finished updating board flags in 1.749 seconds
2013-06-18 16:40:23 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2013-06-18 16:40:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 16:41:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 16:41:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:41:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:41:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:41:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:41:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:41:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:41:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:41:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:41:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:41:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:41:09 [DEBUG   ] Finished updating board flags in 1.617 seconds
2013-06-18 16:41:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 16:41:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 16:42:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 16:42:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:42:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:42:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:42:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:42:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:42:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:42:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:42:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:42:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:42:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:42:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 16:42:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 16:42:09 [DEBUG   ] Finished updating board flags in 1.613 seconds
2013-06-18 16:42:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 16:42:40 [DEBUG   ] Got command RPT from MCS: ref #8712
2013-06-18 16:42:40 [DEBUG   ] summary = ERROR
2013-06-18 16:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8712  13 56461 60160521 A  ERRORERROR'
2013-06-18 16:42:40 [DEBUG   ] Got command RPT from MCS: ref #8713
2013-06-18 16:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 16:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8713  77 56461 60160522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 16:42:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 16:43:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 16:43:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:43:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:43:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:43:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:43:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:43:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:43:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:43:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:43:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:43:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:43:09 [DEBUG   ] Finished updating board flags in 1.649 seconds
2013-06-18 16:43:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 16:43:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 16:44:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 16:44:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:44:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:44:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:44:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:44:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:44:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:44:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:44:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:44:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:44:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:44:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-18 16:44:09 [DEBUG   ] Finished updating board flags in 1.612 seconds
2013-06-18 16:44:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 16:44:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 16:45:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 16:45:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:45:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:45:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:45:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:45:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:45:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:45:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:45:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:45:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:45:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:45:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 16:45:09 [DEBUG   ] Finished updating board flags in 1.568 seconds
2013-06-18 16:45:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 16:45:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 16:46:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 16:46:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:46:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:46:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:46:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:46:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:46:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:46:10 [DEBUG   ] Finished updating board flags in 2.417 seconds
2013-06-18 16:46:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 16:46:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 16:47:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 16:47:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:47:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:47:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:47:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:47:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:47:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:47:10 [DEBUG   ] Finished updating board flags in 2.334 seconds
2013-06-18 16:47:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 16:47:40 [DEBUG   ] Got command RPT from MCS: ref #8729
2013-06-18 16:47:40 [DEBUG   ] summary = ERROR
2013-06-18 16:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8729  13 56461 60460517 A  ERRORERROR'
2013-06-18 16:47:40 [DEBUG   ] Got command RPT from MCS: ref #8730
2013-06-18 16:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 16:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8730  77 56461 60460518 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 16:47:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 16:48:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 16:48:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:48:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:48:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:48:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:48:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:48:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:48:10 [DEBUG   ] Finished updating board flags in 2.220 seconds
2013-06-18 16:48:23 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 16:48:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 16:49:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 16:49:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:49:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:49:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:49:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:49:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:49:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:49:10 [DEBUG   ] Finished updating board flags in 2.177 seconds
2013-06-18 16:49:23 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 16:49:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 16:50:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 16:50:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:50:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:50:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:50:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:50:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:50:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:50:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 16:50:10 [DEBUG   ] Finished updating board flags in 2.072 seconds
2013-06-18 16:50:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 16:50:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 16:51:03 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-06-18 16:51:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:51:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:51:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:51:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:51:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:51:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:51:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:51:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:51:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:51:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:51:10 [DEBUG   ] Finished updating board flags in 1.956 seconds
2013-06-18 16:51:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 16:51:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 16:52:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 16:52:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:52:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:52:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:52:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:52:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:52:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:52:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:52:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:52:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:52:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:52:10 [DEBUG   ] Finished updating board flags in 1.821 seconds
2013-06-18 16:52:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 16:52:40 [DEBUG   ] Got command RPT from MCS: ref #8746
2013-06-18 16:52:40 [DEBUG   ] summary = ERROR
2013-06-18 16:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8746  13 56461 60760517 A  ERRORERROR'
2013-06-18 16:52:40 [DEBUG   ] Got command RPT from MCS: ref #8747
2013-06-18 16:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 16:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8747  77 56461 60760518 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 16:52:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 16:53:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 16:53:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:53:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:53:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:53:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:53:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:53:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:53:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:53:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:53:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:53:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:53:10 [DEBUG   ] Finished updating board flags in 1.784 seconds
2013-06-18 16:53:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 16:53:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 16:54:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 16:54:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:54:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:54:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:54:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:54:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:54:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:54:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:54:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:54:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:54:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:54:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 16:54:10 [DEBUG   ] Finished updating board flags in 1.639 seconds
2013-06-18 16:54:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 16:54:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 16:55:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 16:55:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:55:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:55:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:55:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:55:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:55:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:55:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:55:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:55:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:55:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:55:10 [DEBUG   ] Finished updating board flags in 1.569 seconds
2013-06-18 16:55:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 16:55:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 16:56:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 16:56:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:56:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:56:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:56:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:56:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:56:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:56:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:56:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:56:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:56:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:56:10 [DEBUG   ] Finished updating board flags in 1.521 seconds
2013-06-18 16:56:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 16:56:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 16:57:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 16:57:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:57:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:57:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:57:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:57:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:57:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:57:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 16:57:11 [DEBUG   ] Finished updating board flags in 2.335 seconds
2013-06-18 16:57:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 16:57:40 [DEBUG   ] Got command RPT from MCS: ref #8763
2013-06-18 16:57:40 [DEBUG   ] summary = ERROR
2013-06-18 16:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8763  13 56461 61060517 A  ERRORERROR'
2013-06-18 16:57:40 [DEBUG   ] Got command RPT from MCS: ref #8764
2013-06-18 16:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 16:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8764  77 56461 61060518 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 16:57:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 16:58:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 16:58:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:58:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:58:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:58:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:58:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:58:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:58:11 [DEBUG   ] Finished updating board flags in 2.108 seconds
2013-06-18 16:58:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 16:58:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 16:59:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 16:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 16:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 16:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 16:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 16:59:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 16:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 16:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 16:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 16:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 16:59:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 16:59:11 [DEBUG   ] Finished updating board flags in 2.040 seconds
2013-06-18 16:59:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 16:59:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 17:00:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 17:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:00:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:00:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:00:11 [DEBUG   ] Finished updating board flags in 2.031 seconds
2013-06-18 17:00:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 17:00:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 17:01:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 17:01:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:01:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:01:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:01:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:01:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:01:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:01:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 17:01:11 [DEBUG   ] Finished updating board flags in 1.949 seconds
2013-06-18 17:01:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 17:01:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 17:02:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 17:02:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:02:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:02:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:02:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:02:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:02:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 17:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:02:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:02:11 [DEBUG   ] Finished updating board flags in 1.879 seconds
2013-06-18 17:02:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 17:02:40 [DEBUG   ] Got command RPT from MCS: ref #8780
2013-06-18 17:02:40 [DEBUG   ] summary = ERROR
2013-06-18 17:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8780  13 56461 61360518 A  ERRORERROR'
2013-06-18 17:02:40 [DEBUG   ] Got command RPT from MCS: ref #8781
2013-06-18 17:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 17:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8781  77 56461 61360518 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 17:02:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 17:03:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 17:03:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:03:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:03:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:03:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:03:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:03:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:03:11 [DEBUG   ] Finished updating board flags in 1.723 seconds
2013-06-18 17:03:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 17:03:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 17:04:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 17:04:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:04:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:04:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:04:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:04:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:04:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:04:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:04:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:04:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:04:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:04:11 [DEBUG   ] Finished updating board flags in 1.615 seconds
2013-06-18 17:04:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 17:04:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 17:05:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 17:05:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:05:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:05:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:05:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:05:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:05:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:05:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:05:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:05:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:05:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:05:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 17:05:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-18 17:05:11 [DEBUG   ] Finished updating board flags in 1.634 seconds
2013-06-18 17:05:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 17:05:43 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2013-06-18 17:06:04 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-18 17:06:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:06:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:06:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:06:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:06:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:06:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:06:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:06:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:06:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:06:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:06:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 17:06:11 [DEBUG   ] Finished updating board flags in 1.553 seconds
2013-06-18 17:06:24 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-18 17:06:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 17:07:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 17:07:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:07:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:07:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:07:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:07:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:07:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:07:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:07:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:07:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:07:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:07:11 [DEBUG   ] Finished updating board flags in 1.426 seconds
2013-06-18 17:07:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 17:07:40 [DEBUG   ] Got command RPT from MCS: ref #8797
2013-06-18 17:07:40 [DEBUG   ] summary = ERROR
2013-06-18 17:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8797  13 56461 61660525 A  ERRORERROR'
2013-06-18 17:07:40 [DEBUG   ] Got command RPT from MCS: ref #8798
2013-06-18 17:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 17:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8798  77 56461 61660526 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 17:07:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 17:08:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 17:08:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:08:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:08:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:08:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:08:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:08:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:08:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:08:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:08:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:08:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:08:11 [DEBUG   ] Finished updating board flags in 1.472 seconds
2013-06-18 17:08:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 17:08:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 17:09:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 17:09:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:09:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:09:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:09:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:09:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:09:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:09:12 [DEBUG   ] Finished updating board flags in 2.400 seconds
2013-06-18 17:09:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 17:09:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 17:10:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 17:10:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:10:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:10:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:10:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:10:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:10:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:10:12 [DEBUG   ] Finished updating board flags in 2.111 seconds
2013-06-18 17:10:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 17:10:44 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2013-06-18 17:11:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 17:11:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:11:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:11:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:11:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:11:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:11:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:11:12 [DEBUG   ] Finished updating board flags in 2.029 seconds
2013-06-18 17:11:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 17:11:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 17:12:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 17:12:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:12:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:12:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:12:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:12:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:12:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:12:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 17:12:12 [DEBUG   ] Finished updating board flags in 1.995 seconds
2013-06-18 17:12:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 17:12:40 [DEBUG   ] Got command RPT from MCS: ref #8814
2013-06-18 17:12:40 [DEBUG   ] summary = ERROR
2013-06-18 17:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8814  13 56461 61960529 A  ERRORERROR'
2013-06-18 17:12:40 [DEBUG   ] Got command RPT from MCS: ref #8815
2013-06-18 17:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 17:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8815  77 56461 61960530 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 17:12:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 17:13:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 17:13:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:13:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:13:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:13:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:13:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:13:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:13:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 17:13:12 [DEBUG   ] Finished updating board flags in 1.826 seconds
2013-06-18 17:13:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 17:13:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 17:14:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 17:14:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:14:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:14:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:14:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:14:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:14:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:14:12 [DEBUG   ] Finished updating board flags in 1.766 seconds
2013-06-18 17:14:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 17:14:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 17:15:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 17:15:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:15:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:15:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:15:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:15:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:15:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:15:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:15:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:15:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:15:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:15:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 17:15:12 [DEBUG   ] Finished updating board flags in 1.680 seconds
2013-06-18 17:15:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 17:15:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 17:16:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 17:16:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:16:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:16:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:16:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:16:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:16:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:16:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:16:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:16:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:16:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:16:12 [DEBUG   ] Finished updating board flags in 1.612 seconds
2013-06-18 17:16:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 17:16:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 17:17:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 17:17:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:17:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:17:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:17:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:17:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:17:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:17:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:17:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:17:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:17:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:17:12 [DEBUG   ] Finished updating board flags in 1.500 seconds
2013-06-18 17:17:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 17:17:40 [DEBUG   ] Got command RPT from MCS: ref #8831
2013-06-18 17:17:40 [DEBUG   ] summary = ERROR
2013-06-18 17:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8831  13 56461 62260521 A  ERRORERROR'
2013-06-18 17:17:40 [DEBUG   ] Got command RPT from MCS: ref #8832
2013-06-18 17:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 17:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8832  77 56461 62260522 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 17:17:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 17:18:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 17:18:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:18:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:18:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:18:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:18:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:18:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:18:13 [DEBUG   ] Finished updating board flags in 2.428 seconds
2013-06-18 17:18:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 17:18:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 17:19:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 17:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:19:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:19:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:19:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:19:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:19:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:19:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 17:19:12 [DEBUG   ] Finished updating board flags in 1.388 seconds
2013-06-18 17:19:24 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 17:19:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 17:20:04 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-06-18 17:20:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:20:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:20:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:20:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:20:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:20:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:20:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 17:20:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 17:20:13 [DEBUG   ] Finished updating board flags in 2.223 seconds
2013-06-18 17:20:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 17:20:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 17:21:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 17:21:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:21:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:21:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:21:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:21:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:21:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:21:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 17:21:13 [DEBUG   ] Finished updating board flags in 2.210 seconds
2013-06-18 17:21:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 17:21:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 17:22:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 17:22:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:22:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:22:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:22:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:22:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:22:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 17:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:22:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:22:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 17:22:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-06-18 17:22:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 17:22:13 [CRITICAL] MGT underflow detected on beam(s) 1
2013-06-18 17:22:13 [DEBUG   ] Finished updating board flags in 2.155 seconds
2013-06-18 17:22:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 17:22:40 [DEBUG   ] Got command RPT from MCS: ref #8848
2013-06-18 17:22:40 [DEBUG   ] summary = ERROR
2013-06-18 17:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8848  13 56461 62560529 A  ERRORERROR'
2013-06-18 17:22:40 [DEBUG   ] Got command RPT from MCS: ref #8849
2013-06-18 17:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 17:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8849  77 56461 62560530 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 17:22:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 17:23:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 17:23:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:23:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:23:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:23:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:23:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:23:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:23:13 [DEBUG   ] Finished updating board flags in 2.095 seconds
2013-06-18 17:23:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 17:23:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 17:24:04 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-18 17:24:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:24:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:24:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:24:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:24:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:24:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:24:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 17:24:13 [DEBUG   ] Finished updating board flags in 1.935 seconds
2013-06-18 17:24:25 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-18 17:24:45 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-18 17:25:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 17:25:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:25:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:25:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:25:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:25:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:25:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:25:13 [DEBUG   ] Finished updating board flags in 1.782 seconds
2013-06-18 17:25:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 17:25:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 17:26:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 17:26:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:26:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:26:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:26:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:26:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:26:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:26:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 17:26:13 [DEBUG   ] Finished updating board flags in 1.618 seconds
2013-06-18 17:26:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 17:26:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 17:27:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 17:27:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:27:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:27:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:27:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:27:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:27:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:27:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:27:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:27:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:27:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:27:13 [DEBUG   ] Finished updating board flags in 1.605 seconds
2013-06-18 17:27:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 17:27:40 [DEBUG   ] Got command RPT from MCS: ref #8865
2013-06-18 17:27:40 [DEBUG   ] summary = ERROR
2013-06-18 17:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8865  13 56461 62860525 A  ERRORERROR'
2013-06-18 17:27:40 [DEBUG   ] Got command RPT from MCS: ref #8866
2013-06-18 17:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 17:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8866  77 56461 62860526 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 17:27:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 17:28:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 17:28:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:28:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:28:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:28:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:28:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:28:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:28:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:28:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:28:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:28:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:28:13 [DEBUG   ] Finished updating board flags in 1.622 seconds
2013-06-18 17:28:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 17:28:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 17:29:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 17:29:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:29:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:29:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:29:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:29:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:29:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:29:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:29:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:29:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:29:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:29:13 [DEBUG   ] Finished updating board flags in 1.654 seconds
2013-06-18 17:29:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 17:29:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 17:30:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 17:30:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:30:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:30:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:30:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:30:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:30:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:30:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:30:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:30:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:30:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:30:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 17:30:13 [DEBUG   ] Finished updating board flags in 1.537 seconds
2013-06-18 17:30:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 17:30:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 17:31:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 17:31:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:31:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:31:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:31:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:31:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:31:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:31:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:31:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:31:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:31:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:31:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 17:31:13 [DEBUG   ] Finished updating board flags in 1.456 seconds
2013-06-18 17:31:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 17:31:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 17:32:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 17:32:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:32:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:32:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:32:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:32:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:32:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:32:14 [DEBUG   ] Finished updating board flags in 2.373 seconds
2013-06-18 17:32:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 17:32:40 [DEBUG   ] Got command RPT from MCS: ref #8882
2013-06-18 17:32:40 [DEBUG   ] summary = ERROR
2013-06-18 17:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8882  13 56461 63160533 A  ERRORERROR'
2013-06-18 17:32:40 [DEBUG   ] Got command RPT from MCS: ref #8883
2013-06-18 17:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 17:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8883  77 56461 63160534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 17:32:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 17:33:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 17:33:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:33:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:33:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:33:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:33:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:33:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:33:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 17:33:14 [DEBUG   ] Finished updating board flags in 2.143 seconds
2013-06-18 17:33:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 17:33:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 17:34:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 17:34:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:34:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:34:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:34:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:34:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:34:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:34:14 [DEBUG   ] Finished updating board flags in 2.031 seconds
2013-06-18 17:34:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 17:34:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 17:35:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 17:35:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:35:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:35:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:35:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:35:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:35:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:35:14 [DEBUG   ] Finished updating board flags in 2.032 seconds
2013-06-18 17:35:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 17:35:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 17:36:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 17:36:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:36:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:36:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:36:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:36:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:36:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:36:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 17:36:14 [DEBUG   ] Finished updating board flags in 2.016 seconds
2013-06-18 17:36:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 17:36:45 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-18 17:37:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 17:37:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:37:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:37:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:37:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:37:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:37:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:37:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 17:37:14 [DEBUG   ] Finished updating board flags in 1.930 seconds
2013-06-18 17:37:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 17:37:40 [DEBUG   ] Got command RPT from MCS: ref #8899
2013-06-18 17:37:40 [DEBUG   ] summary = ERROR
2013-06-18 17:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8899  13 56461 63460525 A  ERRORERROR'
2013-06-18 17:37:40 [DEBUG   ] Got command RPT from MCS: ref #8900
2013-06-18 17:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 17:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8900  77 56461 63460526 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 17:37:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 17:38:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 17:38:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:38:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:38:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:38:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:38:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:38:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:38:14 [DEBUG   ] Finished updating board flags in 1.858 seconds
2013-06-18 17:38:25 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2013-06-18 17:38:46 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-18 17:39:06 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-18 17:39:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:39:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:39:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:39:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:39:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:39:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:39:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:39:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:39:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:39:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:39:14 [DEBUG   ] Finished updating board flags in 1.754 seconds
2013-06-18 17:39:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 17:39:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 17:40:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 17:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:40:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:40:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:40:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:40:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:40:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:40:14 [DEBUG   ] Finished updating board flags in 1.606 seconds
2013-06-18 17:40:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-18 17:40:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 17:41:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 17:41:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:41:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:41:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:41:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:41:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:41:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:41:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:41:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:41:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:41:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:41:14 [DEBUG   ] Finished updating board flags in 1.598 seconds
2013-06-18 17:41:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 17:41:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 17:42:06 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 17:42:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:42:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:42:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:42:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:42:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:42:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:42:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:42:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:42:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:42:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:42:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 17:42:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-06-18 17:42:14 [DEBUG   ] Finished updating board flags in 1.398 seconds
2013-06-18 17:42:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 17:42:40 [DEBUG   ] Got command RPT from MCS: ref #8916
2013-06-18 17:42:40 [DEBUG   ] summary = ERROR
2013-06-18 17:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8916  13 56461 63760537 A  ERRORERROR'
2013-06-18 17:42:40 [DEBUG   ] Got command RPT from MCS: ref #8917
2013-06-18 17:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 17:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8917  77 56461 63760538 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 17:42:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 17:43:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 17:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:43:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:43:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:43:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 17:43:15 [DEBUG   ] Finished updating board flags in 2.215 seconds
2013-06-18 17:43:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 17:43:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 17:44:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 17:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:44:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:44:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:44:15 [DEBUG   ] Finished updating board flags in 2.230 seconds
2013-06-18 17:44:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 17:44:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 17:45:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 17:45:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:45:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:45:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:45:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:45:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:45:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:45:15 [DEBUG   ] Finished updating board flags in 2.219 seconds
2013-06-18 17:45:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 17:45:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 17:46:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 17:46:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:46:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:46:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:46:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:46:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:46:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:46:15 [DEBUG   ] Finished updating board flags in 2.209 seconds
2013-06-18 17:46:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 17:46:46 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 17:47:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 17:47:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:47:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:47:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:47:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:47:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:47:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:47:15 [DEBUG   ] Finished updating board flags in 2.137 seconds
2013-06-18 17:47:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 17:47:40 [DEBUG   ] Got command RPT from MCS: ref #8933
2013-06-18 17:47:40 [DEBUG   ] summary = ERROR
2013-06-18 17:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8933  13 56461 64060537 A  ERRORERROR'
2013-06-18 17:47:40 [DEBUG   ] Got command RPT from MCS: ref #8934
2013-06-18 17:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 17:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8934  77 56461 64060538 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 17:47:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 17:48:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 17:48:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:48:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:48:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:48:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:48:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:48:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:48:15 [DEBUG   ] Finished updating board flags in 2.060 seconds
2013-06-18 17:48:26 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 17:48:47 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-18 17:49:07 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 17:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:49:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:49:15 [DEBUG   ] Finished updating board flags in 2.010 seconds
2013-06-18 17:49:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 17:49:47 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-18 17:50:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 17:50:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:50:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:50:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:50:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:50:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:50:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:50:15 [DEBUG   ] Finished updating board flags in 1.936 seconds
2013-06-18 17:50:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 17:50:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 17:51:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 17:51:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:51:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:51:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:51:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:51:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:51:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:51:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 17:51:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 17:51:15 [DEBUG   ] Finished updating board flags in 1.820 seconds
2013-06-18 17:51:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 17:51:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 17:52:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 17:52:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:52:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:52:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:52:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:52:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:52:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:52:15 [DEBUG   ] Finished updating board flags in 1.775 seconds
2013-06-18 17:52:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 17:52:40 [DEBUG   ] Got command RPT from MCS: ref #8950
2013-06-18 17:52:40 [DEBUG   ] summary = ERROR
2013-06-18 17:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8950  13 56461 64360537 A  ERRORERROR'
2013-06-18 17:52:40 [DEBUG   ] Got command RPT from MCS: ref #8951
2013-06-18 17:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 17:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8951  77 56461 64360538 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 17:52:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 17:53:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 17:53:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:53:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:53:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:53:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:53:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:53:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:53:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 17:53:15 [DEBUG   ] Finished updating board flags in 1.626 seconds
2013-06-18 17:53:27 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-18 17:53:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 17:54:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 17:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:54:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:54:15 [DEBUG   ] Finished updating board flags in 1.660 seconds
2013-06-18 17:54:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 17:54:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 17:55:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 17:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:55:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:55:15 [DEBUG   ] Finished updating board flags in 1.540 seconds
2013-06-18 17:55:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 17:55:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 17:56:07 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-18 17:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:56:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:56:15 [DEBUG   ] Finished updating board flags in 1.528 seconds
2013-06-18 17:56:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 17:56:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 17:57:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 17:57:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:57:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:57:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:57:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:57:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:57:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:57:16 [DEBUG   ] Finished updating board flags in 2.323 seconds
2013-06-18 17:57:27 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-18 17:57:40 [DEBUG   ] Got command RPT from MCS: ref #8967
2013-06-18 17:57:40 [DEBUG   ] summary = ERROR
2013-06-18 17:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8967  13 56461 64660529 A  ERRORERROR'
2013-06-18 17:57:40 [DEBUG   ] Got command RPT from MCS: ref #8968
2013-06-18 17:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 17:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8968  77 56461 64660530 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 17:57:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-18 17:58:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-18 17:58:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:58:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:58:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:58:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:58:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:58:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:58:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 17:58:16 [DEBUG   ] Finished updating board flags in 2.147 seconds
2013-06-18 17:58:28 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-18 17:58:48 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-18 17:59:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 17:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 17:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 17:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 17:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 17:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 17:59:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 17:59:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 17:59:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 17:59:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 17:59:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 17:59:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-18 17:59:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 17:59:16 [DEBUG   ] Finished updating board flags in 2.016 seconds
2013-06-18 17:59:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 17:59:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 18:00:08 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2013-06-18 18:00:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:00:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:00:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:00:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:00:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:00:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:00:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 18:00:16 [DEBUG   ] Finished updating board flags in 1.993 seconds
2013-06-18 18:00:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 18:00:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 18:01:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 18:01:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:01:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:01:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:01:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:01:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:01:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:01:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 18:01:16 [DEBUG   ] Finished updating board flags in 1.805 seconds
2013-06-18 18:01:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 18:01:48 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-18 18:02:09 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2013-06-18 18:02:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:02:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:02:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:02:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:02:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:02:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:02:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:02:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:02:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:02:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:02:16 [DEBUG   ] Finished updating board flags in 1.808 seconds
2013-06-18 18:02:29 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 18:02:40 [DEBUG   ] Got command RPT from MCS: ref #8984
2013-06-18 18:02:40 [DEBUG   ] summary = ERROR
2013-06-18 18:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8984  13 56461 64960533 A  ERRORERROR'
2013-06-18 18:02:40 [DEBUG   ] Got command RPT from MCS: ref #8985
2013-06-18 18:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 18:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     8985  77 56461 64960534 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 18:02:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 18:03:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 18:03:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:03:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:03:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:03:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:03:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:03:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:03:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:03:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:03:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:03:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:03:16 [DEBUG   ] Finished updating board flags in 1.781 seconds
2013-06-18 18:03:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 18:03:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 18:04:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 18:04:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:04:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:04:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:04:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:04:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:04:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:04:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:04:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:04:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:04:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:04:16 [DEBUG   ] Finished updating board flags in 1.612 seconds
2013-06-18 18:04:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 18:04:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 18:05:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 18:05:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:05:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:05:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:05:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:05:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:05:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:05:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:05:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:05:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:05:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:05:16 [DEBUG   ] Finished updating board flags in 1.591 seconds
2013-06-18 18:05:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 18:05:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 18:06:09 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2013-06-18 18:06:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:06:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:06:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:06:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:06:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:06:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:06:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:06:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:06:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:06:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:06:16 [DEBUG   ] Finished updating board flags in 1.413 seconds
2013-06-18 18:06:30 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-18 18:06:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 18:07:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 18:07:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:07:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:07:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:07:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:07:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:07:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:07:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:07:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:07:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:07:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:07:16 [DEBUG   ] Finished updating board flags in 1.383 seconds
2013-06-18 18:07:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 18:07:40 [DEBUG   ] Got command RPT from MCS: ref #9001
2013-06-18 18:07:40 [DEBUG   ] summary = ERROR
2013-06-18 18:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9001  13 56461 65260537 A  ERRORERROR'
2013-06-18 18:07:40 [DEBUG   ] Got command RPT from MCS: ref #9002
2013-06-18 18:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 18:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9002  77 56461 65260538 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 18:07:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 18:08:10 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 18:08:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:08:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:08:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:08:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:08:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:08:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:08:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:08:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:08:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:08:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:08:17 [DEBUG   ] Finished updating board flags in 2.213 seconds
2013-06-18 18:08:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 18:08:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 18:09:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 18:09:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:09:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:09:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:09:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:09:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:09:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:09:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:09:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:09:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:09:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:09:17 [DEBUG   ] Finished updating board flags in 2.197 seconds
2013-06-18 18:09:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 18:09:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 18:10:10 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-18 18:10:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:10:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:10:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:10:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:10:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:10:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:10:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:10:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:10:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:10:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:10:17 [DEBUG   ] Finished updating board flags in 2.006 seconds
2013-06-18 18:10:30 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-18 18:10:51 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-18 18:11:11 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-18 18:11:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:11:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:11:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:11:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:11:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:11:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:11:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:11:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:11:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:11:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:11:17 [DEBUG   ] Finished updating board flags in 2.010 seconds
2013-06-18 18:11:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 18:11:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 18:12:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 18:12:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:12:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:12:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:12:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:12:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:12:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:12:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:12:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:12:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:12:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:12:17 [DEBUG   ] Finished updating board flags in 1.988 seconds
2013-06-18 18:12:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 18:12:40 [DEBUG   ] Got command RPT from MCS: ref #9018
2013-06-18 18:12:40 [DEBUG   ] summary = ERROR
2013-06-18 18:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9018  13 56461 65560537 A  ERRORERROR'
2013-06-18 18:12:40 [DEBUG   ] Got command RPT from MCS: ref #9019
2013-06-18 18:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 18:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9019  77 56461 65560538 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 18:12:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 18:13:11 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-18 18:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:13:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:13:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:13:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:13:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:13:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:13:17 [DEBUG   ] Finished updating board flags in 1.811 seconds
2013-06-18 18:13:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 18:13:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 18:14:11 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 18:14:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:14:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:14:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:14:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:14:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:14:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:14:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:14:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:14:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:14:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:14:17 [DEBUG   ] Finished updating board flags in 1.800 seconds
2013-06-18 18:14:31 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-18 18:14:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 18:15:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 18:15:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:15:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:15:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:15:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:15:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:15:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:15:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:15:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:15:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:15:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:15:17 [DEBUG   ] Finished updating board flags in 1.805 seconds
2013-06-18 18:15:31 [DEBUG   ] Finished updating ant stats in 0.592 seconds
2013-06-18 18:15:52 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-18 18:16:12 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-18 18:16:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:16:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:16:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:16:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:16:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:16:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 18:16:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:16:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:16:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:16:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:16:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:16:17 [DEBUG   ] Finished updating board flags in 1.801 seconds
2013-06-18 18:16:32 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 18:16:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 18:17:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 18:17:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:17:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:17:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:17:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:17:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:17:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:17:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:17:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:17:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:17:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:17:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 18:17:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 18:17:17 [DEBUG   ] Finished updating board flags in 1.785 seconds
2013-06-18 18:17:32 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-18 18:17:40 [DEBUG   ] Got command RPT from MCS: ref #9035
2013-06-18 18:17:40 [DEBUG   ] summary = ERROR
2013-06-18 18:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9035  13 56461 65860537 A  ERRORERROR'
2013-06-18 18:17:40 [DEBUG   ] Got command RPT from MCS: ref #9036
2013-06-18 18:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 18:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9036  77 56461 65860538 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 18:17:52 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 18:18:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 18:18:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:18:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:18:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:18:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:18:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:18:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:18:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:18:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:18:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:18:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:18:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 18:18:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 18:18:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-18 18:18:17 [DEBUG   ] Finished updating board flags in 1.611 seconds
2013-06-18 18:18:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 18:18:52 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-18 18:19:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 18:19:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:19:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:19:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:19:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:19:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:19:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 18:19:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:19:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:19:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:19:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:19:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:19:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 18:19:17 [DEBUG   ] Finished updating board flags in 1.611 seconds
2013-06-18 18:19:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 18:19:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 18:20:12 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 18:20:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:20:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:20:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:20:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:20:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:20:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:20:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:20:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:20:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:20:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:20:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 18:20:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 18:20:17 [DEBUG   ] Finished updating board flags in 1.583 seconds
2013-06-18 18:20:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 18:20:53 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-18 18:21:13 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 18:21:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:21:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:21:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:21:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:21:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:21:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:21:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:21:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:21:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:21:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:21:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 18:21:17 [DEBUG   ] Finished updating board flags in 1.413 seconds
2013-06-18 18:21:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 18:21:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 18:22:13 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-18 18:22:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:22:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:22:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:22:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:22:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:22:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:22:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:22:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:22:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:22:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:22:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 18:22:17 [DEBUG   ] Finished updating board flags in 1.393 seconds
2013-06-18 18:22:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 18:22:40 [DEBUG   ] Got command RPT from MCS: ref #9052
2013-06-18 18:22:40 [DEBUG   ] summary = ERROR
2013-06-18 18:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9052  13 56461 66160537 A  ERRORERROR'
2013-06-18 18:22:40 [DEBUG   ] Got command RPT from MCS: ref #9053
2013-06-18 18:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 18:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9053  77 56461 66160538 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 18:22:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 18:23:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 18:23:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:23:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:23:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:23:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:23:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:23:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:23:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:23:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:23:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:23:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:23:18 [DEBUG   ] Finished updating board flags in 2.213 seconds
2013-06-18 18:23:33 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-18 18:23:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 18:24:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 18:24:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:24:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:24:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:24:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:24:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:24:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:24:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:24:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:24:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:24:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:24:18 [DEBUG   ] Finished updating board flags in 2.252 seconds
2013-06-18 18:24:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 18:24:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 18:25:13 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 18:25:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:25:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:25:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:25:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:25:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:25:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:25:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:25:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:25:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:25:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:25:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 18:25:18 [DEBUG   ] Finished updating board flags in 2.160 seconds
2013-06-18 18:25:33 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2013-06-18 18:25:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-18 18:26:13 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-18 18:26:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:26:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:26:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:26:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:26:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:26:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:26:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:26:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:26:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:26:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:26:18 [DEBUG   ] Finished updating board flags in 2.013 seconds
2013-06-18 18:26:34 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-18 18:26:54 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-18 18:27:14 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 18:27:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:27:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:27:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:27:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:27:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:27:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:27:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:27:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:27:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:27:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:27:18 [DEBUG   ] Finished updating board flags in 1.992 seconds
2013-06-18 18:27:34 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-18 18:27:40 [DEBUG   ] Got command RPT from MCS: ref #9069
2013-06-18 18:27:40 [DEBUG   ] summary = ERROR
2013-06-18 18:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9069  13 56461 66460545 A  ERRORERROR'
2013-06-18 18:27:40 [DEBUG   ] Got command RPT from MCS: ref #9070
2013-06-18 18:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 18:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9070  77 56461 66460546 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 18:27:54 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 18:28:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 18:28:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:28:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:28:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:28:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:28:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:28:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:28:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:28:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:28:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:28:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:28:18 [DEBUG   ] Finished updating board flags in 1.802 seconds
2013-06-18 18:28:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 18:28:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 18:29:14 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 18:29:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:29:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:29:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:29:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:29:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:29:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:29:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:29:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:29:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:29:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:29:18 [DEBUG   ] Finished updating board flags in 1.794 seconds
2013-06-18 18:29:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 18:29:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 18:30:14 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-18 18:30:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:30:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:30:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:30:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:30:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:30:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:30:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:30:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:30:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:30:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:30:18 [DEBUG   ] Finished updating board flags in 1.604 seconds
2013-06-18 18:30:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 18:30:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 18:31:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 18:31:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:31:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:31:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:31:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:31:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:31:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:31:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:31:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:31:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:31:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:31:18 [DEBUG   ] Finished updating board flags in 1.629 seconds
2013-06-18 18:31:34 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 18:31:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 18:32:14 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-18 18:32:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:32:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:32:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:32:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:32:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:32:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:32:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:32:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:32:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:32:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:32:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-18 18:32:18 [DEBUG   ] Finished updating board flags in 1.576 seconds
2013-06-18 18:32:34 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-18 18:32:40 [DEBUG   ] Got command RPT from MCS: ref #9086
2013-06-18 18:32:40 [DEBUG   ] summary = ERROR
2013-06-18 18:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9086  13 56461 66760549 A  ERRORERROR'
2013-06-18 18:32:40 [DEBUG   ] Got command RPT from MCS: ref #9087
2013-06-18 18:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 18:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9087  77 56461 66760550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 18:32:55 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-18 18:33:15 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-18 18:33:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:33:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:33:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:33:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:33:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:33:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:33:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:33:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:33:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:33:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:33:18 [DEBUG   ] Finished updating board flags in 1.392 seconds
2013-06-18 18:33:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 18:33:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 18:34:15 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-18 18:34:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:34:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:34:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:34:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:34:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:34:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:34:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:34:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:34:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:34:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:34:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 18:34:19 [DEBUG   ] Finished updating board flags in 2.207 seconds
2013-06-18 18:34:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 18:34:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 18:35:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 18:35:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:35:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:35:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:35:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:35:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:35:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 18:35:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:35:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:35:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:35:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:35:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:35:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-18 18:35:19 [DEBUG   ] Finished updating board flags in 2.198 seconds
2013-06-18 18:35:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 18:35:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 18:36:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 18:36:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:36:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:36:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:36:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:36:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:36:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:36:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:36:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:36:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:36:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:36:19 [DEBUG   ] Finished updating board flags in 2.007 seconds
2013-06-18 18:36:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 18:36:55 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-18 18:37:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 18:37:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:37:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:37:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:37:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:37:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:37:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:37:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:37:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:37:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:37:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:37:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 18:37:19 [DEBUG   ] Finished updating board flags in 2.007 seconds
2013-06-18 18:37:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 18:37:40 [DEBUG   ] Got command RPT from MCS: ref #9103
2013-06-18 18:37:40 [DEBUG   ] summary = ERROR
2013-06-18 18:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9103  13 56461 67060549 A  ERRORERROR'
2013-06-18 18:37:40 [DEBUG   ] Got command RPT from MCS: ref #9104
2013-06-18 18:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 18:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9104  77 56461 67060550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 18:37:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 18:38:15 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-18 18:38:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:38:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:38:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:38:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:38:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:38:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:38:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:38:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:38:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:38:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:38:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 18:38:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-18 18:38:19 [DEBUG   ] Finished updating board flags in 1.993 seconds
2013-06-18 18:38:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-18 18:38:55 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-18 18:39:16 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-18 18:39:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:39:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:39:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:39:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:39:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:39:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:39:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:39:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:39:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:39:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:39:19 [DEBUG   ] Finished updating board flags in 1.808 seconds
2013-06-18 18:39:36 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-18 18:39:56 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-18 18:40:16 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2013-06-18 18:40:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:40:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:40:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:40:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:40:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:40:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:40:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:40:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:40:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:40:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:40:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 18:40:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 18:40:19 [DEBUG   ] Finished updating board flags in 1.790 seconds
2013-06-18 18:40:36 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 18:40:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 18:41:16 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-18 18:41:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:41:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:41:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:41:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:41:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:41:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 18:41:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:41:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:41:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:41:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:41:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:41:19 [DEBUG   ] Finished updating board flags in 1.614 seconds
2013-06-18 18:41:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 18:41:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 18:42:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 18:42:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:42:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:42:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:42:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:42:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:42:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:42:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:42:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:42:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:42:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:42:19 [DEBUG   ] Finished updating board flags in 1.606 seconds
2013-06-18 18:42:36 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 18:42:40 [DEBUG   ] Got command RPT from MCS: ref #9120
2013-06-18 18:42:40 [DEBUG   ] summary = ERROR
2013-06-18 18:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9120  13 56461 67360549 A  ERRORERROR'
2013-06-18 18:42:40 [DEBUG   ] Got command RPT from MCS: ref #9121
2013-06-18 18:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 18:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9121  77 56461 67360550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 18:42:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 18:43:17 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-18 18:43:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:43:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:43:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:43:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:43:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:43:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:43:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:43:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:43:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:43:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:43:19 [DEBUG   ] Finished updating board flags in 1.589 seconds
2013-06-18 18:43:37 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 18:43:57 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 18:44:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 18:44:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:44:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:44:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:44:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:44:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:44:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:44:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:44:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:44:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:44:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:44:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 18:44:19 [DEBUG   ] Finished updating board flags in 1.413 seconds
2013-06-18 18:44:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 18:44:57 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-18 18:45:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 18:45:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:45:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:45:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:45:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:45:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:45:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:45:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:45:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:45:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:45:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:45:19 [DEBUG   ] Finished updating board flags in 1.426 seconds
2013-06-18 18:45:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 18:45:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 18:46:17 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-18 18:46:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:46:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:46:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:46:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:46:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:46:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:46:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:46:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:46:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:46:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:46:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-06-18 18:46:19 [DEBUG   ] Finished updating board flags in 1.358 seconds
2013-06-18 18:46:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 18:46:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 18:47:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 18:47:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:47:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:47:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:47:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:47:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:47:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:47:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:47:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:47:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:47:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:47:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 18:47:20 [DEBUG   ] Finished updating board flags in 2.219 seconds
2013-06-18 18:47:37 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 18:47:40 [DEBUG   ] Got command RPT from MCS: ref #9137
2013-06-18 18:47:40 [DEBUG   ] summary = ERROR
2013-06-18 18:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9137  13 56461 67660545 A  ERRORERROR'
2013-06-18 18:47:40 [DEBUG   ] Got command RPT from MCS: ref #9138
2013-06-18 18:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 18:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9138  77 56461 67660546 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 18:47:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 18:48:18 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-18 18:48:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:48:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:48:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:48:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:48:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:48:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:48:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:48:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:48:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:48:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:48:20 [DEBUG   ] Finished updating board flags in 2.198 seconds
2013-06-18 18:48:38 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-18 18:48:58 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 18:49:18 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-18 18:49:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:49:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:49:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:49:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:49:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:49:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:49:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:49:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:49:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:49:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:49:20 [DEBUG   ] Finished updating board flags in 2.012 seconds
2013-06-18 18:49:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 18:49:58 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-18 18:50:18 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2013-06-18 18:50:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:50:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:50:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:50:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:50:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:50:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:50:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:50:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:50:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:50:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:50:20 [DEBUG   ] Finished updating board flags in 1.991 seconds
2013-06-18 18:50:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 18:50:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 18:51:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 18:51:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:51:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:51:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:51:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:51:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:51:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:51:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:51:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:51:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:51:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:51:20 [DEBUG   ] Finished updating board flags in 1.809 seconds
2013-06-18 18:51:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 18:51:58 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-18 18:52:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 18:52:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:52:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:52:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:52:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:52:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:52:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:52:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:52:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:52:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:52:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:52:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 18:52:20 [DEBUG   ] Finished updating board flags in 1.789 seconds
2013-06-18 18:52:38 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 18:52:40 [DEBUG   ] Got command RPT from MCS: ref #9154
2013-06-18 18:52:40 [DEBUG   ] summary = ERROR
2013-06-18 18:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9154  13 56461 67960541 A  ERRORERROR'
2013-06-18 18:52:40 [DEBUG   ] Got command RPT from MCS: ref #9155
2013-06-18 18:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 18:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9155  77 56461 67960542 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 18:52:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 18:53:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:53:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:53:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:53:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:53:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:53:19 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-18 18:53:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:53:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:53:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:53:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:53:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:53:20 [DEBUG   ] Finished updating board flags in 1.608 seconds
2013-06-18 18:53:39 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 18:53:59 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-18 18:54:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:54:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:54:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:54:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:54:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:54:19 [DEBUG   ] Finished updating ant stats in 1.049 seconds
2013-06-18 18:54:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:54:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:54:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:54:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:54:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:54:20 [DEBUG   ] Finished updating board flags in 1.607 seconds
2013-06-18 18:54:39 [DEBUG   ] Finished updating ant stats in 0.957 seconds
2013-06-18 18:54:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 18:55:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:55:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:55:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:55:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:55:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:55:19 [DEBUG   ] Finished updating ant stats in 0.841 seconds
2013-06-18 18:55:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:55:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:55:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:55:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:55:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:55:20 [DEBUG   ] Finished updating board flags in 1.589 seconds
2013-06-18 18:55:39 [DEBUG   ] Finished updating ant stats in 0.755 seconds
2013-06-18 18:55:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 18:56:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:56:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:56:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:56:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:56:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:56:19 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2013-06-18 18:56:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 18:56:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:56:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:56:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:56:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:56:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:56:20 [DEBUG   ] Finished updating board flags in 1.411 seconds
2013-06-18 18:56:39 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2013-06-18 18:57:00 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-18 18:57:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:57:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:57:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:57:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:57:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:57:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:57:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:57:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:57:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:57:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:57:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 18:57:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 18:57:20 [DEBUG   ] Finished updating ant stats in 1.251 seconds
2013-06-18 18:57:20 [DEBUG   ] Finished updating board flags in 1.458 seconds
2013-06-18 18:57:40 [DEBUG   ] Finished updating ant stats in 1.158 seconds
2013-06-18 18:57:40 [DEBUG   ] Got command RPT from MCS: ref #9171
2013-06-18 18:57:40 [DEBUG   ] summary = ERROR
2013-06-18 18:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9171  13 56461 68260545 A  ERRORERROR'
2013-06-18 18:57:40 [DEBUG   ] Got command RPT from MCS: ref #9172
2013-06-18 18:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 18:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9172  77 56461 68260546 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 18:58:00 [DEBUG   ] Finished updating ant stats in 0.907 seconds
2013-06-18 18:58:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:58:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:58:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:58:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:58:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:58:20 [DEBUG   ] Finished updating ant stats in 0.850 seconds
2013-06-18 18:58:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:58:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:58:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:58:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:58:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:58:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 18:58:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 18:58:21 [DEBUG   ] Finished updating board flags in 2.252 seconds
2013-06-18 18:58:40 [DEBUG   ] Finished updating ant stats in 0.755 seconds
2013-06-18 18:59:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 18:59:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 18:59:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 18:59:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 18:59:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 18:59:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 18:59:20 [DEBUG   ] Finished updating ant stats in 0.648 seconds
2013-06-18 18:59:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 18:59:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 18:59:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 18:59:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 18:59:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 18:59:21 [DEBUG   ] Finished updating board flags in 2.187 seconds
2013-06-18 18:59:40 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2013-06-18 19:00:01 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-18 19:00:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:00:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:00:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:00:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:00:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:00:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:00:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:00:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:00:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:00:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:00:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 19:00:21 [DEBUG   ] Finished updating ant stats in 1.252 seconds
2013-06-18 19:00:21 [DEBUG   ] Finished updating board flags in 2.064 seconds
2013-06-18 19:00:41 [DEBUG   ] Finished updating ant stats in 1.161 seconds
2013-06-18 19:01:01 [DEBUG   ] Finished updating ant stats in 0.835 seconds
2013-06-18 19:01:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:01:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:01:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:01:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:01:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:01:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:01:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:01:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:01:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:01:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:01:21 [DEBUG   ] Finished updating ant stats in 0.844 seconds
2013-06-18 19:01:21 [DEBUG   ] Finished updating board flags in 1.994 seconds
2013-06-18 19:01:41 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2013-06-18 19:02:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 19:02:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:02:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:02:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:02:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:02:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:02:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:02:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:02:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:02:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:02:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:02:21 [DEBUG   ] Finished updating ant stats in 0.643 seconds
2013-06-18 19:02:21 [DEBUG   ] Finished updating board flags in 1.815 seconds
2013-06-18 19:02:40 [DEBUG   ] Got command RPT from MCS: ref #9188
2013-06-18 19:02:40 [DEBUG   ] summary = ERROR
2013-06-18 19:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9188  13 56461 68560553 A  ERRORERROR'
2013-06-18 19:02:40 [DEBUG   ] Got command RPT from MCS: ref #9189
2013-06-18 19:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 19:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9189  77 56461 68560554 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 19:02:41 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2013-06-18 19:03:01 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-18 19:03:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:03:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:03:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:03:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:03:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:03:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 19:03:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:03:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:03:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:03:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:03:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:03:21 [DEBUG   ] Finished updating board flags in 1.847 seconds
2013-06-18 19:03:22 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-18 19:03:42 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-18 19:04:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 19:04:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:04:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:04:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:04:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:04:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:04:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:04:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:04:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:04:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:04:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:04:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 19:04:21 [DEBUG   ] Finished updating board flags in 1.796 seconds
2013-06-18 19:04:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 19:04:42 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 19:05:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 19:05:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:05:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:05:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:05:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:05:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:05:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:05:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:05:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:05:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:05:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:05:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 19:05:21 [DEBUG   ] Finished updating board flags in 1.563 seconds
2013-06-18 19:05:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 19:05:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 19:06:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 19:06:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:06:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:06:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:06:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:06:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:06:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:06:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:06:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:06:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:06:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:06:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 19:06:22 [DEBUG   ] Finished updating ant stats in 0.642 seconds
2013-06-18 19:06:22 [DEBUG   ] Finished updating board flags in 2.411 seconds
2013-06-18 19:06:42 [DEBUG   ] Finished updating ant stats in 0.559 seconds
2013-06-18 19:07:03 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2013-06-18 19:07:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:07:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:07:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:07:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:07:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:07:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:07:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:07:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:07:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:07:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:07:22 [DEBUG   ] Finished updating board flags in 2.380 seconds
2013-06-18 19:07:23 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-18 19:07:40 [DEBUG   ] Got command RPT from MCS: ref #9205
2013-06-18 19:07:40 [DEBUG   ] summary = ERROR
2013-06-18 19:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9205  13 56461 68860549 A  ERRORERROR'
2013-06-18 19:07:40 [DEBUG   ] Got command RPT from MCS: ref #9206
2013-06-18 19:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 19:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9206  77 56461 68860550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 19:07:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 19:08:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 19:08:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:08:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:08:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:08:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:08:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:08:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:08:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:08:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:08:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:08:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:08:22 [DEBUG   ] Finished updating board flags in 2.246 seconds
2013-06-18 19:08:23 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-18 19:08:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 19:09:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 19:09:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:09:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:09:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:09:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:09:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:09:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:09:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:09:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:09:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:09:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:09:22 [DEBUG   ] Finished updating board flags in 2.163 seconds
2013-06-18 19:09:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 19:09:43 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-18 19:10:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 19:10:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:10:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:10:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:10:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:10:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:10:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:10:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:10:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:10:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:10:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:10:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 19:10:22 [DEBUG   ] Finished updating board flags in 2.011 seconds
2013-06-18 19:10:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 19:10:43 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2013-06-18 19:11:04 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-18 19:11:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:11:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:11:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:11:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:11:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:11:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:11:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:11:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:11:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:11:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:11:22 [DEBUG   ] Finished updating board flags in 1.942 seconds
2013-06-18 19:11:24 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 19:11:44 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 19:12:04 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-18 19:12:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:12:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:12:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:12:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:12:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:12:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:12:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:12:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:12:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:12:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:12:22 [DEBUG   ] Finished updating board flags in 1.818 seconds
2013-06-18 19:12:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 19:12:40 [DEBUG   ] Got command RPT from MCS: ref #9222
2013-06-18 19:12:40 [DEBUG   ] summary = ERROR
2013-06-18 19:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9222  13 56461 69160549 A  ERRORERROR'
2013-06-18 19:12:40 [DEBUG   ] Got command RPT from MCS: ref #9223
2013-06-18 19:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 19:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9223  77 56461 69160550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 19:12:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 19:13:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 19:13:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:13:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:13:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:13:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:13:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:13:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:13:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:13:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:13:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:13:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:13:22 [DEBUG   ] Finished updating board flags in 1.779 seconds
2013-06-18 19:13:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 19:13:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 19:14:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 19:14:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:14:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:14:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:14:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:14:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:14:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:14:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:14:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:14:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:14:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:14:22 [DEBUG   ] Finished updating board flags in 1.628 seconds
2013-06-18 19:14:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 19:14:45 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-18 19:15:05 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 19:15:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:15:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:15:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:15:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:15:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:15:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:15:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:15:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:15:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:15:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:15:22 [DEBUG   ] Finished updating board flags in 1.573 seconds
2013-06-18 19:15:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 19:15:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 19:16:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 19:16:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:16:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:16:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:16:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:16:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:16:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:16:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:16:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:16:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:16:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:16:22 [DEBUG   ] Finished updating board flags in 1.413 seconds
2013-06-18 19:16:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 19:16:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 19:17:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 19:17:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:17:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:17:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:17:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:17:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:17:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:17:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:17:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:17:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:17:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:17:23 [DEBUG   ] Finished updating board flags in 2.400 seconds
2013-06-18 19:17:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 19:17:40 [DEBUG   ] Got command RPT from MCS: ref #9239
2013-06-18 19:17:40 [DEBUG   ] summary = ERROR
2013-06-18 19:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9239  13 56461 69460549 A  ERRORERROR'
2013-06-18 19:17:40 [DEBUG   ] Got command RPT from MCS: ref #9240
2013-06-18 19:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 19:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9240  77 56461 69460550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 19:17:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 19:18:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 19:18:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:18:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:18:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:18:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:18:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:18:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:18:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:18:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:18:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:18:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:18:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 19:18:23 [DEBUG   ] Finished updating board flags in 2.194 seconds
2013-06-18 19:18:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 19:18:45 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 19:19:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 19:19:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:19:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:19:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:19:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:19:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:19:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:19:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:19:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:19:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:19:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:19:23 [DEBUG   ] Finished updating board flags in 2.015 seconds
2013-06-18 19:19:26 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2013-06-18 19:19:46 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-18 19:20:06 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-18 19:20:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:20:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:20:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:20:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:20:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:20:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:20:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:20:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:20:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:20:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:20:23 [DEBUG   ] Finished updating board flags in 2.009 seconds
2013-06-18 19:20:26 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2013-06-18 19:20:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 19:21:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 19:21:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:21:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:21:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:21:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:21:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:21:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:21:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:21:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:21:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:21:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:21:23 [DEBUG   ] Finished updating board flags in 1.982 seconds
2013-06-18 19:21:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 19:21:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 19:22:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 19:22:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:22:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:22:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:22:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:22:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:22:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:22:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:22:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:22:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:22:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:22:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 19:22:23 [DEBUG   ] Finished updating board flags in 1.814 seconds
2013-06-18 19:22:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 19:22:40 [DEBUG   ] Got command RPT from MCS: ref #9256
2013-06-18 19:22:40 [DEBUG   ] summary = ERROR
2013-06-18 19:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9256  13 56461 69760549 A  ERRORERROR'
2013-06-18 19:22:40 [DEBUG   ] Got command RPT from MCS: ref #9257
2013-06-18 19:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 19:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9257  77 56461 69760550 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 19:22:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 19:23:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 19:23:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:23:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:23:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:23:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:23:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:23:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:23:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:23:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:23:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:23:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:23:23 [DEBUG   ] Finished updating board flags in 1.841 seconds
2013-06-18 19:23:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 19:23:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 19:24:06 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 19:24:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:24:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:24:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:24:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:24:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:24:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:24:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:24:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:24:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:24:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:24:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 19:24:23 [DEBUG   ] Finished updating board flags in 1.753 seconds
2013-06-18 19:24:26 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 19:24:47 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-18 19:25:07 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 19:25:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:25:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:25:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:25:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:25:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:25:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 19:25:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:25:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:25:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:25:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:25:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:25:23 [DEBUG   ] Finished updating board flags in 1.608 seconds
2013-06-18 19:25:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 19:25:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 19:26:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 19:26:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:26:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:26:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:26:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:26:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:26:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 19:26:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:26:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:26:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:26:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:26:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:26:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 19:26:23 [DEBUG   ] Finished updating board flags in 1.594 seconds
2013-06-18 19:26:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 19:26:47 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-18 19:27:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 19:27:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:27:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:27:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:27:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:27:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:27:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:27:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:27:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:27:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:27:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:27:23 [DEBUG   ] Finished updating board flags in 1.420 seconds
2013-06-18 19:27:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 19:27:40 [DEBUG   ] Got command RPT from MCS: ref #9273
2013-06-18 19:27:40 [DEBUG   ] summary = ERROR
2013-06-18 19:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9273  13 56461 70060557 A  ERRORERROR'
2013-06-18 19:27:40 [DEBUG   ] Got command RPT from MCS: ref #9274
2013-06-18 19:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 19:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9274  77 56461 70060558 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 19:27:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 19:28:07 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-18 19:28:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:28:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:28:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:28:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:28:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:28:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:28:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:28:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:28:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:28:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:28:24 [DEBUG   ] Finished updating board flags in 2.395 seconds
2013-06-18 19:28:27 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-18 19:28:48 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-18 19:29:08 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-18 19:29:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:29:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:29:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:29:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:29:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:29:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:29:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:29:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:29:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:29:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:29:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 19:29:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-06-18 19:29:24 [DEBUG   ] Finished updating board flags in 2.210 seconds
2013-06-18 19:29:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 19:29:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 19:30:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 19:30:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:30:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:30:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:30:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:30:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:30:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:30:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:30:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:30:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:30:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:30:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-06-18 19:30:24 [DEBUG   ] Finished updating board flags in 2.141 seconds
2013-06-18 19:30:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 19:30:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 19:31:08 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-18 19:31:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:31:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:31:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:31:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:31:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:31:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:31:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:31:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:31:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:31:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:31:24 [DEBUG   ] Finished updating board flags in 2.012 seconds
2013-06-18 19:31:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 19:31:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 19:32:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 19:32:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:32:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:32:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:32:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:32:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:32:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:32:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:32:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:32:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:32:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:32:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 19:32:24 [DEBUG   ] Finished updating board flags in 1.986 seconds
2013-06-18 19:32:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 19:32:40 [DEBUG   ] Got command RPT from MCS: ref #9290
2013-06-18 19:32:40 [DEBUG   ] summary = ERROR
2013-06-18 19:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9290  13 56461 70360557 A  ERRORERROR'
2013-06-18 19:32:40 [DEBUG   ] Got command RPT from MCS: ref #9291
2013-06-18 19:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 19:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9291  77 56461 70360558 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 19:32:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 19:33:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 19:33:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:33:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:33:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:33:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:33:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:33:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:33:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:33:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:33:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:33:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:33:24 [DEBUG   ] Finished updating board flags in 1.812 seconds
2013-06-18 19:33:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 19:33:48 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 19:34:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 19:34:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:34:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:34:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:34:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:34:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:34:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:34:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:34:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:34:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:34:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:34:24 [DEBUG   ] Finished updating board flags in 1.813 seconds
2013-06-18 19:34:29 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-18 19:34:49 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 19:35:09 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 19:35:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:35:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:35:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:35:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:35:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:35:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:35:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:35:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:35:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:35:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:35:24 [DEBUG   ] Finished updating board flags in 1.774 seconds
2013-06-18 19:35:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 19:35:49 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-18 19:36:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 19:36:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:36:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:36:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:36:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:36:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:36:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:36:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:36:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:36:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:36:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:36:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 19:36:24 [DEBUG   ] Finished updating board flags in 1.616 seconds
2013-06-18 19:36:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 19:36:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 19:37:09 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-18 19:37:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:37:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:37:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:37:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:37:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:37:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:37:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:37:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:37:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:37:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:37:24 [DEBUG   ] Finished updating board flags in 1.592 seconds
2013-06-18 19:37:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 19:37:40 [DEBUG   ] Got command RPT from MCS: ref #9307
2013-06-18 19:37:40 [DEBUG   ] summary = ERROR
2013-06-18 19:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9307  13 56461 70660553 A  ERRORERROR'
2013-06-18 19:37:40 [DEBUG   ] Got command RPT from MCS: ref #9308
2013-06-18 19:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 19:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9308  77 56461 70660554 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 19:37:49 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2013-06-18 19:38:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 19:38:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:38:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:38:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:38:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:38:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:38:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:38:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:38:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:38:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:38:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:38:24 [DEBUG   ] Finished updating board flags in 1.421 seconds
2013-06-18 19:38:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 19:38:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 19:39:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 19:39:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:39:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:39:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:39:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:39:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:39:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:39:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:39:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:39:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:39:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:39:24 [DEBUG   ] Finished updating board flags in 1.387 seconds
2013-06-18 19:39:30 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-18 19:39:50 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-18 19:40:10 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 19:40:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:40:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:40:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:40:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:40:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:40:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:40:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:40:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:40:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:40:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:40:25 [DEBUG   ] Finished updating board flags in 2.213 seconds
2013-06-18 19:40:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 19:40:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 19:41:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 19:41:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:41:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:41:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:41:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:41:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:41:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:41:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:41:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:41:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:41:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:41:25 [DEBUG   ] Finished updating board flags in 2.196 seconds
2013-06-18 19:41:30 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2013-06-18 19:41:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 19:42:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 19:42:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:42:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:42:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:42:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:42:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:42:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:42:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:42:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:42:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:42:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:42:25 [DEBUG   ] Finished updating board flags in 2.006 seconds
2013-06-18 19:42:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 19:42:40 [DEBUG   ] Got command RPT from MCS: ref #9324
2013-06-18 19:42:40 [DEBUG   ] summary = ERROR
2013-06-18 19:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9324  13 56461 70960557 A  ERRORERROR'
2013-06-18 19:42:40 [DEBUG   ] Got command RPT from MCS: ref #9325
2013-06-18 19:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 19:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9325  77 56461 70960558 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 19:42:50 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 19:43:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 19:43:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:43:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:43:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:43:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:43:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:43:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 19:43:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:43:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:43:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:43:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:43:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:43:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 19:43:25 [DEBUG   ] Finished updating board flags in 2.007 seconds
2013-06-18 19:43:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 19:43:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 19:44:10 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 19:44:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:44:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:44:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:44:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:44:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:44:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:44:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:44:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:44:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:44:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:44:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 19:44:25 [DEBUG   ] Finished updating board flags in 1.998 seconds
2013-06-18 19:44:31 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-18 19:44:51 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-18 19:45:11 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-18 19:45:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:45:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:45:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:45:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:45:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:45:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:45:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:45:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:45:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:45:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:45:25 [DEBUG   ] Finished updating board flags in 1.810 seconds
2013-06-18 19:45:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 19:45:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 19:46:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 19:46:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:46:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:46:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:46:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:46:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:46:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:46:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:46:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 19:46:25 [DEBUG   ] Finished updating board flags in 1.784 seconds
2013-06-18 19:46:31 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-18 19:46:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 19:47:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 19:47:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:47:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:47:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:47:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:47:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:47:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:47:25 [DEBUG   ] Finished updating board flags in 1.621 seconds
2013-06-18 19:47:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 19:47:40 [DEBUG   ] Got command RPT from MCS: ref #9341
2013-06-18 19:47:40 [DEBUG   ] summary = ERROR
2013-06-18 19:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9341  13 56461 71260557 A  ERRORERROR'
2013-06-18 19:47:40 [DEBUG   ] Got command RPT from MCS: ref #9342
2013-06-18 19:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 19:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9342  77 56461 71260558 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 19:47:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 19:48:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 19:48:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:48:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:48:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:48:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:48:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:48:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:48:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:48:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:48:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:48:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:48:25 [DEBUG   ] Finished updating board flags in 1.592 seconds
2013-06-18 19:48:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 19:48:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 19:49:11 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-18 19:49:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:49:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:49:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:49:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:49:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:49:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:49:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:49:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:49:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:49:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:49:25 [DEBUG   ] Finished updating board flags in 1.423 seconds
2013-06-18 19:49:32 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-18 19:49:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 19:50:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 19:50:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:50:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:50:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:50:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:50:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:50:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:50:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:50:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:50:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:50:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:50:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 19:50:25 [DEBUG   ] Finished updating board flags in 1.375 seconds
2013-06-18 19:50:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 19:50:52 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 19:51:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 19:51:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:51:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:51:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:51:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:51:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:51:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:51:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:51:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:51:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:51:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:51:26 [DEBUG   ] Finished updating board flags in 2.214 seconds
2013-06-18 19:51:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 19:51:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 19:52:12 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-18 19:52:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:52:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:52:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:52:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:52:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:52:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:52:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:52:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:52:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:52:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:52:26 [DEBUG   ] Finished updating board flags in 2.197 seconds
2013-06-18 19:52:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 19:52:40 [DEBUG   ] Got command RPT from MCS: ref #9358
2013-06-18 19:52:40 [DEBUG   ] summary = ERROR
2013-06-18 19:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9358  13 56461 71560561 A  ERRORERROR'
2013-06-18 19:52:40 [DEBUG   ] Got command RPT from MCS: ref #9359
2013-06-18 19:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 19:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9359  77 56461 71560562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 19:52:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 19:53:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 19:53:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:53:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:53:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:53:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:53:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:53:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:53:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:53:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:53:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:53:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:53:26 [DEBUG   ] Finished updating board flags in 2.006 seconds
2013-06-18 19:53:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 19:53:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 19:54:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 19:54:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:54:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:54:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:54:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:54:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:54:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:54:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:54:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:54:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:54:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:54:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 19:54:26 [DEBUG   ] Finished updating board flags in 2.009 seconds
2013-06-18 19:54:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 19:54:52 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 19:55:12 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2013-06-18 19:55:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:55:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:55:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:55:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:55:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:55:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:55:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:55:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:55:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:55:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:55:26 [DEBUG   ] Finished updating board flags in 1.979 seconds
2013-06-18 19:55:33 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-18 19:55:53 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 19:56:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 19:56:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:56:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:56:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:56:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:56:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:56:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:56:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:56:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:56:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:56:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:56:26 [DEBUG   ] Finished updating board flags in 1.824 seconds
2013-06-18 19:56:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 19:56:53 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-18 19:57:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 19:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:57:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:57:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:57:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:57:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:57:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:57:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:57:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 19:57:26 [DEBUG   ] Finished updating board flags in 1.788 seconds
2013-06-18 19:57:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 19:57:40 [DEBUG   ] Got command RPT from MCS: ref #9375
2013-06-18 19:57:40 [DEBUG   ] summary = ERROR
2013-06-18 19:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9375  13 56461 71860557 A  ERRORERROR'
2013-06-18 19:57:40 [DEBUG   ] Got command RPT from MCS: ref #9376
2013-06-18 19:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 19:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9376  77 56461 71860558 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 19:57:53 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-18 19:58:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 19:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:58:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:58:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:58:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:58:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:58:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:58:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:58:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 19:58:26 [DEBUG   ] Finished updating board flags in 1.616 seconds
2013-06-18 19:58:33 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-18 19:58:53 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 19:59:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 19:59:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 19:59:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 19:59:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 19:59:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 19:59:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 19:59:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 19:59:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 19:59:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 19:59:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 19:59:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 19:59:26 [DEBUG   ] Finished updating board flags in 1.589 seconds
2013-06-18 19:59:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 19:59:53 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 20:00:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 20:00:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:00:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:00:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:00:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:00:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:00:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:00:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:00:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:00:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:00:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:00:26 [DEBUG   ] Finished updating board flags in 1.485 seconds
2013-06-18 20:00:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-18 20:00:53 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-18 20:01:14 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-18 20:01:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:01:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:01:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:01:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:01:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:01:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:01:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:01:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:01:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:01:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:01:27 [DEBUG   ] Finished updating board flags in 2.401 seconds
2013-06-18 20:01:34 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-18 20:01:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 20:02:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 20:02:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:02:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:02:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:02:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:02:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:02:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:02:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:02:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:02:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:02:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:02:27 [DEBUG   ] Finished updating board flags in 2.321 seconds
2013-06-18 20:02:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 20:02:40 [DEBUG   ] Got command RPT from MCS: ref #9392
2013-06-18 20:02:40 [DEBUG   ] summary = ERROR
2013-06-18 20:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9392  13 56461 72160561 A  ERRORERROR'
2013-06-18 20:02:40 [DEBUG   ] Got command RPT from MCS: ref #9393
2013-06-18 20:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 20:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9393  77 56461 72160562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 20:02:54 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-18 20:03:14 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-18 20:03:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:03:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:03:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:03:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:03:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:03:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:03:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:03:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:03:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:03:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:03:27 [DEBUG   ] Finished updating board flags in 2.208 seconds
2013-06-18 20:03:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 20:03:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 20:04:14 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-18 20:04:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:04:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:04:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:04:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:04:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:04:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:04:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:04:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:04:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:04:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:04:27 [DEBUG   ] Finished updating board flags in 2.209 seconds
2013-06-18 20:04:34 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 20:04:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 20:05:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 20:05:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:05:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:05:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:05:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:05:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:05:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:05:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:05:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:05:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:05:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:05:27 [DEBUG   ] Finished updating board flags in 2.193 seconds
2013-06-18 20:05:35 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-18 20:05:55 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-18 20:06:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 20:06:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:06:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:06:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:06:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:06:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:06:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:06:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:06:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:06:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:06:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:06:27 [DEBUG   ] Finished updating board flags in 2.011 seconds
2013-06-18 20:06:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 20:06:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 20:07:15 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-18 20:07:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:07:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:07:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:07:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:07:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:07:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:07:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:07:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:07:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:07:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:07:27 [DEBUG   ] Finished updating board flags in 1.991 seconds
2013-06-18 20:07:35 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-18 20:07:40 [DEBUG   ] Got command RPT from MCS: ref #9409
2013-06-18 20:07:40 [DEBUG   ] summary = ERROR
2013-06-18 20:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9409  13 56461 72460561 A  ERRORERROR'
2013-06-18 20:07:40 [DEBUG   ] Got command RPT from MCS: ref #9410
2013-06-18 20:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 20:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9410  77 56461 72460562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 20:07:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 20:08:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 20:08:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:08:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:08:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:08:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:08:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:08:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:08:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:08:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:08:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:08:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:08:27 [DEBUG   ] Finished updating board flags in 1.737 seconds
2013-06-18 20:08:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 20:08:55 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 20:09:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 20:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:09:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:09:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:09:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:09:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:09:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:09:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:09:27 [DEBUG   ] Finished updating board flags in 1.583 seconds
2013-06-18 20:09:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 20:09:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 20:10:15 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-18 20:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:10:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:10:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:10:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:10:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:10:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:10:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:10:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-18 20:10:27 [DEBUG   ] Finished updating board flags in 1.431 seconds
2013-06-18 20:10:36 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-18 20:10:55 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-18 20:11:16 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-18 20:11:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:11:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:11:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:11:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:11:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:11:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:11:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:11:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:11:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:11:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:11:27 [DEBUG   ] Finished updating board flags in 1.409 seconds
2013-06-18 20:11:36 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-18 20:11:56 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-18 20:12:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 20:12:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:12:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:12:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:12:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:12:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:12:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:12:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:12:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:12:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:12:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:12:27 [DEBUG   ] Finished updating board flags in 1.366 seconds
2013-06-18 20:12:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 20:12:40 [DEBUG   ] Got command RPT from MCS: ref #9426
2013-06-18 20:12:40 [DEBUG   ] summary = ERROR
2013-06-18 20:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9426  13 56461 72760569 A  ERRORERROR'
2013-06-18 20:12:40 [DEBUG   ] Got command RPT from MCS: ref #9427
2013-06-18 20:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 20:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9427  77 56461 72760570 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 20:12:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 20:13:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 20:13:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:13:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:13:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:13:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:13:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:13:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:13:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:13:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:13:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:13:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:13:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 20:13:28 [DEBUG   ] Finished updating board flags in 2.225 seconds
2013-06-18 20:13:36 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 20:13:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 20:14:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 20:14:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:14:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:14:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:14:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:14:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:14:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:14:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:14:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:14:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:14:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:14:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 20:14:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 20:14:28 [DEBUG   ] Finished updating board flags in 2.195 seconds
2013-06-18 20:14:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 20:14:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 20:15:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 20:15:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:15:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:15:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:15:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:15:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:15:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:15:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:15:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:15:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:15:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:15:28 [DEBUG   ] Finished updating board flags in 2.003 seconds
2013-06-18 20:15:36 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 20:15:56 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 20:16:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 20:16:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:16:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:16:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:16:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:16:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:16:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:16:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:16:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:16:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:16:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:16:28 [DEBUG   ] Finished updating board flags in 2.013 seconds
2013-06-18 20:16:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-18 20:16:57 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-06-18 20:17:17 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-18 20:17:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:17:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:17:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:17:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:17:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:17:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:17:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:17:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:17:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:17:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:17:28 [DEBUG   ] Finished updating board flags in 2.010 seconds
2013-06-18 20:17:37 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-18 20:17:40 [DEBUG   ] Got command RPT from MCS: ref #9443
2013-06-18 20:17:40 [DEBUG   ] summary = ERROR
2013-06-18 20:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9443  13 56461 73060565 A  ERRORERROR'
2013-06-18 20:17:40 [DEBUG   ] Got command RPT from MCS: ref #9444
2013-06-18 20:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 20:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9444  77 56461 73060566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 20:17:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 20:18:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 20:18:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:18:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:18:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:18:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:18:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:18:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:18:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:18:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:18:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:18:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:18:28 [DEBUG   ] Finished updating board flags in 1.975 seconds
2013-06-18 20:18:37 [DEBUG   ] Finished updating ant stats in 1.191 seconds
2013-06-18 20:18:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 20:19:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 20:19:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:19:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:19:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:19:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:19:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:19:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:19:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:19:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:19:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:19:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:19:28 [DEBUG   ] Finished updating board flags in 1.816 seconds
2013-06-18 20:19:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 20:19:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 20:20:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 20:20:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:20:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:20:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:20:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:20:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:20:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:20:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:20:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:20:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:20:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:20:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-18 20:20:28 [DEBUG   ] Finished updating board flags in 1.789 seconds
2013-06-18 20:20:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 20:20:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 20:21:17 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 20:21:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:21:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:21:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:21:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:21:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:21:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:21:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:21:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:21:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:21:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:21:28 [DEBUG   ] Finished updating board flags in 1.603 seconds
2013-06-18 20:21:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-18 20:21:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-18 20:22:18 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-18 20:22:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:22:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:22:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:22:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:22:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:22:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:22:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:22:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:22:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:22:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:22:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 20:22:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 20:22:28 [DEBUG   ] Finished updating board flags in 1.616 seconds
2013-06-18 20:22:38 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-18 20:22:40 [DEBUG   ] Got command RPT from MCS: ref #9460
2013-06-18 20:22:40 [DEBUG   ] summary = ERROR
2013-06-18 20:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9460  13 56461 73360565 A  ERRORERROR'
2013-06-18 20:22:40 [DEBUG   ] Got command RPT from MCS: ref #9461
2013-06-18 20:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 20:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9461  77 56461 73360566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 20:22:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 20:23:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 20:23:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:23:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:23:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:23:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:23:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:23:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:23:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:23:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:23:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:23:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:23:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 20:23:28 [DEBUG   ] Finished updating board flags in 1.532 seconds
2013-06-18 20:23:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 20:23:58 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-18 20:24:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 20:24:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:24:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:24:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:24:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:24:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:24:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:24:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:24:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:24:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:24:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:24:28 [DEBUG   ] Finished updating board flags in 1.407 seconds
2013-06-18 20:24:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 20:24:58 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 20:25:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 20:25:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:25:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:25:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:25:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:25:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:25:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:25:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:25:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:25:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:25:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:25:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 20:25:28 [DEBUG   ] Finished updating board flags in 1.390 seconds
2013-06-18 20:25:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 20:25:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 20:26:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 20:26:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:26:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:26:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:26:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:26:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:26:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:26:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:26:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:26:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:26:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:26:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 20:26:29 [DEBUG   ] Finished updating board flags in 2.252 seconds
2013-06-18 20:26:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 20:26:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 20:27:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 20:27:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:27:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:27:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:27:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:27:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:27:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:27:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:27:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:27:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:27:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:27:29 [DEBUG   ] Finished updating board flags in 2.207 seconds
2013-06-18 20:27:38 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 20:27:40 [DEBUG   ] Got command RPT from MCS: ref #9477
2013-06-18 20:27:40 [DEBUG   ] summary = ERROR
2013-06-18 20:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9477  13 56461 73660561 A  ERRORERROR'
2013-06-18 20:27:40 [DEBUG   ] Got command RPT from MCS: ref #9478
2013-06-18 20:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 20:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9478  77 56461 73660562 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 20:27:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-18 20:28:19 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-18 20:28:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:28:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:28:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:28:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:28:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:28:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:28:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:28:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:28:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:28:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:28:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 20:28:29 [DEBUG   ] Finished updating board flags in 2.155 seconds
2013-06-18 20:28:39 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-18 20:28:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 20:29:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 20:29:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:29:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:29:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:29:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:29:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:29:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:29:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:29:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:29:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:29:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:29:29 [DEBUG   ] Finished updating board flags in 2.016 seconds
2013-06-18 20:29:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 20:29:59 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2013-06-18 20:30:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 20:30:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:30:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:30:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:30:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:30:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:30:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:30:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:30:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:30:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:30:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:30:29 [DEBUG   ] Finished updating board flags in 1.986 seconds
2013-06-18 20:30:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 20:30:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 20:31:19 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-18 20:31:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:31:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:31:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:31:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:31:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:31:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:31:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:31:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:31:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:31:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:31:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 20:31:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-18 20:31:29 [DEBUG   ] Finished updating board flags in 1.815 seconds
2013-06-18 20:31:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 20:31:59 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 20:32:19 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 20:32:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:32:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:32:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:32:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:32:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:32:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:32:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:32:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:32:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:32:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:32:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 20:32:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 20:32:29 [DEBUG   ] Finished updating board flags in 1.789 seconds
2013-06-18 20:32:39 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2013-06-18 20:32:40 [DEBUG   ] Got command RPT from MCS: ref #9494
2013-06-18 20:32:40 [DEBUG   ] summary = ERROR
2013-06-18 20:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9494  13 56461 73960565 A  ERRORERROR'
2013-06-18 20:32:40 [DEBUG   ] Got command RPT from MCS: ref #9495
2013-06-18 20:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 20:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9495  77 56461 73960566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 20:32:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-18 20:33:20 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-18 20:33:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:33:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:33:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:33:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:33:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:33:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:33:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:33:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:33:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:33:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:33:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 20:33:29 [DEBUG   ] Finished updating board flags in 1.613 seconds
2013-06-18 20:33:40 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-18 20:34:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 20:34:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 20:34:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:34:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:34:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:34:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:34:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:34:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:34:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:34:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:34:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:34:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:34:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 20:34:29 [DEBUG   ] Finished updating board flags in 1.607 seconds
2013-06-18 20:34:40 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 20:35:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 20:35:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 20:35:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:35:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:35:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:35:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:35:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:35:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:35:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:35:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:35:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:35:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:35:29 [DEBUG   ] Finished updating board flags in 1.588 seconds
2013-06-18 20:35:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 20:36:00 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2013-06-18 20:36:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 20:36:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:36:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:36:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:36:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:36:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:36:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 20:36:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:36:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:36:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:36:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:36:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:36:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 20:36:29 [DEBUG   ] Finished updating board flags in 1.408 seconds
2013-06-18 20:36:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 20:37:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 20:37:20 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 20:37:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:37:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:37:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:37:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:37:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:37:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:37:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:37:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:37:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:37:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:37:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 20:37:29 [DEBUG   ] Finished updating board flags in 1.405 seconds
2013-06-18 20:37:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 20:37:40 [DEBUG   ] Got command RPT from MCS: ref #9511
2013-06-18 20:37:40 [DEBUG   ] summary = ERROR
2013-06-18 20:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9511  13 56461 74260573 A  ERRORERROR'
2013-06-18 20:37:40 [DEBUG   ] Got command RPT from MCS: ref #9512
2013-06-18 20:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 20:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9512  77 56461 74260574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 20:38:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 20:38:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 20:38:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:38:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:38:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:38:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:38:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:38:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:38:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:38:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:38:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:38:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:38:29 [DEBUG   ] Finished updating board flags in 1.407 seconds
2013-06-18 20:38:40 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 20:39:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-18 20:39:21 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-18 20:39:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:39:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:39:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:39:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:39:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:39:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:39:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:39:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:39:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:39:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:39:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 20:39:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 20:39:29 [DEBUG   ] Finished updating board flags in 1.383 seconds
2013-06-18 20:39:41 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-18 20:40:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 20:40:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 20:40:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:40:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:40:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:40:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:40:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:40:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:40:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:40:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:40:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:40:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:40:30 [DEBUG   ] Finished updating board flags in 2.219 seconds
2013-06-18 20:40:41 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 20:41:01 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 20:41:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 20:41:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:41:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:41:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:41:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:41:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:41:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:41:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:41:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:41:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:41:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:41:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 20:41:30 [DEBUG   ] Finished updating board flags in 2.188 seconds
2013-06-18 20:41:41 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-18 20:42:01 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 20:42:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 20:42:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:42:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:42:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:42:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:42:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:42:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:42:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:42:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:42:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:42:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:42:30 [DEBUG   ] Finished updating board flags in 2.067 seconds
2013-06-18 20:42:40 [DEBUG   ] Got command RPT from MCS: ref #9528
2013-06-18 20:42:40 [DEBUG   ] summary = ERROR
2013-06-18 20:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9528  13 56461 74560574 A  ERRORERROR'
2013-06-18 20:42:40 [DEBUG   ] Got command RPT from MCS: ref #9529
2013-06-18 20:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 20:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9529  77 56461 74560574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 20:42:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 20:43:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-18 20:43:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 20:43:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:43:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:43:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:43:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:43:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:43:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:43:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:43:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:43:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:43:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:43:30 [DEBUG   ] Finished updating board flags in 1.952 seconds
2013-06-18 20:43:41 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 20:44:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 20:44:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 20:44:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:44:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:44:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:44:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:44:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:44:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:44:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:44:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:44:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:44:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:44:30 [DEBUG   ] Finished updating board flags in 1.800 seconds
2013-06-18 20:44:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 20:45:01 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 20:45:22 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-18 20:45:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:45:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:45:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:45:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:45:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:45:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:45:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:45:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:45:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:45:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:45:30 [DEBUG   ] Finished updating board flags in 1.612 seconds
2013-06-18 20:45:42 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 20:46:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 20:46:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 20:46:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:46:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:46:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:46:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:46:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:46:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:46:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:46:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:46:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:46:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:46:30 [DEBUG   ] Finished updating board flags in 1.589 seconds
2013-06-18 20:46:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 20:47:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 20:47:22 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 20:47:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:47:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:47:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:47:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:47:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:47:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:47:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:47:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:47:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:47:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:47:30 [DEBUG   ] Finished updating board flags in 1.483 seconds
2013-06-18 20:47:40 [DEBUG   ] Got command RPT from MCS: ref #9545
2013-06-18 20:47:40 [DEBUG   ] summary = ERROR
2013-06-18 20:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9545  13 56461 74860565 A  ERRORERROR'
2013-06-18 20:47:40 [DEBUG   ] Got command RPT from MCS: ref #9546
2013-06-18 20:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 20:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9546  77 56461 74860566 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 20:47:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 20:48:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 20:48:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 20:48:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:48:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:48:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:48:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:48:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:48:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:48:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:48:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:48:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:48:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:48:31 [DEBUG   ] Finished updating board flags in 2.398 seconds
2013-06-18 20:48:42 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 20:49:02 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-18 20:49:23 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-18 20:49:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:49:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:49:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:49:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:49:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:49:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:49:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:49:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:49:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:49:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:49:31 [DEBUG   ] Finished updating board flags in 2.234 seconds
2013-06-18 20:49:43 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-18 20:50:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 20:50:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 20:50:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:50:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:50:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:50:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:50:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:50:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:50:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:50:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:50:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:50:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:50:31 [DEBUG   ] Finished updating board flags in 2.096 seconds
2013-06-18 20:50:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 20:51:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 20:51:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 20:51:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:51:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:51:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:51:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:51:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:51:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:51:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:51:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:51:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:51:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:51:31 [DEBUG   ] Finished updating board flags in 2.047 seconds
2013-06-18 20:51:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 20:52:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 20:52:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 20:52:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:52:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:52:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:52:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:52:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:52:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:52:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:52:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:52:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:52:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:52:31 [DEBUG   ] Finished updating board flags in 1.969 seconds
2013-06-18 20:52:40 [DEBUG   ] Got command RPT from MCS: ref #9562
2013-06-18 20:52:40 [DEBUG   ] summary = ERROR
2013-06-18 20:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9562  13 56461 75160573 A  ERRORERROR'
2013-06-18 20:52:40 [DEBUG   ] Got command RPT from MCS: ref #9563
2013-06-18 20:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 20:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9563  77 56461 75160574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 20:52:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 20:53:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 20:53:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 20:53:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:53:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:53:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:53:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:53:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:53:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:53:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:53:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:53:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:53:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:53:31 [DEBUG   ] Finished updating board flags in 1.839 seconds
2013-06-18 20:53:43 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-18 20:54:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 20:54:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 20:54:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:54:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:54:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:54:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:54:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:54:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:54:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:54:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:54:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:54:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:54:31 [DEBUG   ] Finished updating board flags in 1.757 seconds
2013-06-18 20:54:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 20:55:03 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-18 20:55:24 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-18 20:55:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:55:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:55:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:55:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:55:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:55:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:55:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:55:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:55:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:55:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:55:31 [DEBUG   ] Finished updating board flags in 1.635 seconds
2013-06-18 20:55:44 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-18 20:56:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 20:56:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 20:56:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:56:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:56:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:56:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:56:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:56:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:56:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:56:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:56:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:56:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:56:31 [DEBUG   ] Finished updating board flags in 1.559 seconds
2013-06-18 20:56:44 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 20:57:04 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 20:57:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 20:57:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:57:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:57:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:57:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:57:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:57:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:57:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:57:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:57:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:57:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:57:31 [DEBUG   ] Finished updating board flags in 1.421 seconds
2013-06-18 20:57:40 [DEBUG   ] Got command RPT from MCS: ref #9579
2013-06-18 20:57:40 [DEBUG   ] summary = ERROR
2013-06-18 20:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9579  13 56461 75460577 A  ERRORERROR'
2013-06-18 20:57:40 [DEBUG   ] Got command RPT from MCS: ref #9580
2013-06-18 20:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 20:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9580  77 56461 75460578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 20:57:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 20:58:04 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-18 20:58:24 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 20:58:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:58:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:58:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:58:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:58:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:58:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:58:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:58:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:58:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:58:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:58:31 [DEBUG   ] Finished updating board flags in 1.399 seconds
2013-06-18 20:58:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 20:59:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 20:59:24 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-18 20:59:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 20:59:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 20:59:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 20:59:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 20:59:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 20:59:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 20:59:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 20:59:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 20:59:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 20:59:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 20:59:32 [DEBUG   ] Finished updating board flags in 2.216 seconds
2013-06-18 20:59:44 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 21:00:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 21:00:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 21:00:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:00:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:00:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:00:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:00:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:00:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:00:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:00:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:00:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:00:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:00:32 [DEBUG   ] Finished updating board flags in 2.172 seconds
2013-06-18 21:00:44 [DEBUG   ] Finished updating ant stats in 0.592 seconds
2013-06-18 21:01:05 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-18 21:01:25 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-18 21:01:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:01:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:01:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:01:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:01:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:01:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:01:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:01:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:01:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:01:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:01:32 [DEBUG   ] Finished updating board flags in 2.016 seconds
2013-06-18 21:01:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 21:02:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 21:02:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 21:02:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:02:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:02:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:02:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:02:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:02:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 21:02:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:02:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:02:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:02:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:02:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:02:32 [DEBUG   ] Finished updating board flags in 2.002 seconds
2013-06-18 21:02:40 [DEBUG   ] Got command RPT from MCS: ref #9596
2013-06-18 21:02:40 [DEBUG   ] summary = ERROR
2013-06-18 21:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9596  13 56461 75760577 A  ERRORERROR'
2013-06-18 21:02:40 [DEBUG   ] Got command RPT from MCS: ref #9597
2013-06-18 21:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 21:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9597  77 56461 75760578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 21:02:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 21:03:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 21:03:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 21:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:03:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:03:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:03:32 [DEBUG   ] Finished updating board flags in 1.990 seconds
2013-06-18 21:03:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 21:04:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 21:04:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 21:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:04:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:04:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:04:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 21:04:32 [DEBUG   ] Finished updating board flags in 1.810 seconds
2013-06-18 21:04:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 21:05:06 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-18 21:05:26 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 21:05:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:05:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:05:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:05:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:05:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:05:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:05:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:05:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:05:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:05:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:05:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 21:05:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 21:05:32 [DEBUG   ] Finished updating board flags in 1.792 seconds
2013-06-18 21:05:46 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 21:06:06 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2013-06-18 21:06:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 21:06:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:06:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:06:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:06:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:06:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:06:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:06:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:06:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:06:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:06:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:06:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 21:06:32 [DEBUG   ] Finished updating board flags in 1.619 seconds
2013-06-18 21:06:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 21:07:06 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 21:07:26 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-18 21:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:07:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:07:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 21:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:07:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:07:32 [DEBUG   ] Finished updating board flags in 1.597 seconds
2013-06-18 21:07:40 [DEBUG   ] Got command RPT from MCS: ref #9613
2013-06-18 21:07:40 [DEBUG   ] summary = ERROR
2013-06-18 21:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9613  13 56461 76060573 A  ERRORERROR'
2013-06-18 21:07:40 [DEBUG   ] Got command RPT from MCS: ref #9614
2013-06-18 21:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 21:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9614  77 56461 76060574 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 21:07:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-18 21:08:07 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-18 21:08:27 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-18 21:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:08:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:08:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:08:32 [DEBUG   ] Finished updating board flags in 1.397 seconds
2013-06-18 21:08:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 21:09:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 21:09:27 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-18 21:09:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:09:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:09:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:09:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:09:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:09:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:09:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:09:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:09:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:09:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:09:33 [DEBUG   ] Finished updating board flags in 2.213 seconds
2013-06-18 21:09:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 21:10:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 21:10:27 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 21:10:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:10:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:10:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:10:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:10:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:10:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:10:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:10:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:10:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:10:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:10:33 [DEBUG   ] Finished updating board flags in 2.190 seconds
2013-06-18 21:10:47 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-18 21:11:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 21:11:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 21:11:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:11:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:11:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:11:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:11:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:11:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:11:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:11:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:11:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:11:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:11:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 21:11:33 [DEBUG   ] Finished updating board flags in 2.013 seconds
2013-06-18 21:11:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 21:12:07 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2013-06-18 21:12:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 21:12:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:12:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:12:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:12:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:12:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:12:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:12:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:12:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:12:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:12:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:12:33 [DEBUG   ] Finished updating board flags in 1.983 seconds
2013-06-18 21:12:40 [DEBUG   ] Got command RPT from MCS: ref #9630
2013-06-18 21:12:40 [DEBUG   ] summary = ERROR
2013-06-18 21:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9630  13 56461 76360581 A  ERRORERROR'
2013-06-18 21:12:40 [DEBUG   ] Got command RPT from MCS: ref #9631
2013-06-18 21:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 21:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9631  77 56461 76360582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 21:12:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 21:13:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 21:13:27 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-18 21:13:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:13:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:13:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:13:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:13:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:13:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:13:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:13:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:13:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:13:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:13:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 21:13:33 [DEBUG   ] Finished updating board flags in 1.895 seconds
2013-06-18 21:13:47 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-18 21:14:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-18 21:14:27 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-18 21:14:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:14:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:14:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:14:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:14:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:14:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:14:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:14:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:14:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:14:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:14:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 21:14:33 [DEBUG   ] Finished updating board flags in 1.815 seconds
2013-06-18 21:14:48 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-18 21:15:08 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-18 21:15:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 21:15:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:15:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:15:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:15:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:15:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:15:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:15:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:15:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:15:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:15:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:15:33 [DEBUG   ] Finished updating board flags in 1.696 seconds
2013-06-18 21:15:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 21:16:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 21:16:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 21:16:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:16:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:16:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:16:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:16:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:16:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:16:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:16:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:16:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:16:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:16:33 [DEBUG   ] Finished updating board flags in 1.616 seconds
2013-06-18 21:16:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 21:17:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 21:17:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 21:17:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:17:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:17:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:17:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:17:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:17:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:17:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:17:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:17:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:17:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:17:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 21:17:33 [DEBUG   ] Finished updating board flags in 1.611 seconds
2013-06-18 21:17:40 [DEBUG   ] Got command RPT from MCS: ref #9647
2013-06-18 21:17:40 [DEBUG   ] summary = ERROR
2013-06-18 21:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9647  13 56461 76660577 A  ERRORERROR'
2013-06-18 21:17:40 [DEBUG   ] Got command RPT from MCS: ref #9648
2013-06-18 21:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 21:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9648  77 56461 76660578 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 21:17:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 21:18:08 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2013-06-18 21:18:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 21:18:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:18:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:18:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:18:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:18:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:18:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:18:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:18:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:18:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:18:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:18:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 21:18:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 21:18:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-18 21:18:33 [DEBUG   ] Finished updating board flags in 1.595 seconds
2013-06-18 21:18:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 21:19:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 21:19:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 21:19:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:19:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:19:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:19:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:19:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:19:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:19:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:19:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:19:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:19:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:19:33 [DEBUG   ] Finished updating board flags in 1.429 seconds
2013-06-18 21:19:49 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-18 21:20:09 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 21:20:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 21:20:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:20:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:20:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:20:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:20:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:20:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:20:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:20:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:20:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:20:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:20:33 [DEBUG   ] Finished updating board flags in 1.408 seconds
2013-06-18 21:20:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 21:21:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 21:21:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 21:21:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:21:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:21:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:21:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:21:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:21:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:21:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:21:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:21:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:21:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:21:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 21:21:33 [DEBUG   ] Finished updating board flags in 1.408 seconds
2013-06-18 21:21:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 21:22:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 21:22:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 21:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:22:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:22:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:22:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:22:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:22:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:22:33 [DEBUG   ] Finished updating board flags in 1.363 seconds
2013-06-18 21:22:40 [DEBUG   ] Got command RPT from MCS: ref #9664
2013-06-18 21:22:40 [DEBUG   ] summary = ERROR
2013-06-18 21:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9664  13 56461 76960581 A  ERRORERROR'
2013-06-18 21:22:40 [DEBUG   ] Got command RPT from MCS: ref #9665
2013-06-18 21:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 21:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9665  77 56461 76960582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 21:22:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 21:23:09 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 21:23:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 21:23:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:23:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:23:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:23:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:23:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:23:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:23:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:23:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:23:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:23:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:23:34 [DEBUG   ] Finished updating board flags in 2.217 seconds
2013-06-18 21:23:49 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 21:24:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 21:24:29 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 21:24:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:24:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:24:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:24:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:24:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:24:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:24:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:24:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:24:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:24:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:24:34 [DEBUG   ] Finished updating board flags in 2.257 seconds
2013-06-18 21:24:49 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-18 21:25:09 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-18 21:25:29 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-18 21:25:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:25:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:25:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:25:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:25:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:25:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:25:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:25:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:25:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:25:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:25:34 [DEBUG   ] Finished updating board flags in 2.123 seconds
2013-06-18 21:25:50 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2013-06-18 21:26:10 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-18 21:26:30 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-18 21:26:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:26:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:26:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:26:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:26:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:26:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:26:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:26:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:26:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:26:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:26:34 [DEBUG   ] Finished updating board flags in 2.020 seconds
2013-06-18 21:26:50 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 21:27:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 21:27:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 21:27:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:27:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:27:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:27:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:27:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:27:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:27:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:27:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:27:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:27:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:27:34 [DEBUG   ] Finished updating board flags in 1.984 seconds
2013-06-18 21:27:40 [DEBUG   ] Got command RPT from MCS: ref #9681
2013-06-18 21:27:40 [DEBUG   ] summary = ERROR
2013-06-18 21:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9681  13 56461 77260581 A  ERRORERROR'
2013-06-18 21:27:40 [DEBUG   ] Got command RPT from MCS: ref #9682
2013-06-18 21:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 21:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9682  77 56461 77260582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 21:27:50 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-18 21:28:10 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 21:28:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 21:28:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:28:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:28:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:28:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:28:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:28:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:28:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:28:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:28:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:28:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:28:34 [DEBUG   ] Finished updating board flags in 1.822 seconds
2013-06-18 21:28:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 21:29:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 21:29:30 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 21:29:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:29:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:29:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:29:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:29:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:29:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:29:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:29:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:29:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:29:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:29:34 [DEBUG   ] Finished updating board flags in 1.792 seconds
2013-06-18 21:29:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 21:30:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 21:30:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 21:30:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:30:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:30:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:30:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:30:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:30:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:30:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:30:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:30:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:30:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:30:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 21:30:34 [DEBUG   ] Finished updating board flags in 1.611 seconds
2013-06-18 21:30:50 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 21:31:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-18 21:31:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-18 21:31:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:31:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:31:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:31:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:31:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:31:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:31:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:31:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:31:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:31:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:31:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 21:31:34 [DEBUG   ] Finished updating board flags in 1.591 seconds
2013-06-18 21:31:51 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-18 21:32:11 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-18 21:32:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 21:32:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:32:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:32:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:32:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:32:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:32:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:32:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:32:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:32:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:32:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:32:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 21:32:34 [DEBUG   ] Finished updating board flags in 1.416 seconds
2013-06-18 21:32:40 [DEBUG   ] Got command RPT from MCS: ref #9698
2013-06-18 21:32:40 [DEBUG   ] summary = ERROR
2013-06-18 21:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9698  13 56461 77560585 A  ERRORERROR'
2013-06-18 21:32:40 [DEBUG   ] Got command RPT from MCS: ref #9699
2013-06-18 21:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 21:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9699  77 56461 77560586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 21:32:51 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 21:33:11 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-18 21:33:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 21:33:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:33:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:33:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:33:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:33:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:33:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:33:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:33:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:33:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:33:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:33:34 [DEBUG   ] Finished updating board flags in 1.407 seconds
2013-06-18 21:33:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 21:34:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 21:34:31 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 21:34:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:34:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:34:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:34:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:34:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:34:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 21:34:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:34:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:34:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:34:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:34:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:34:34 [DEBUG   ] Finished updating board flags in 1.407 seconds
2013-06-18 21:34:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 21:35:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 21:35:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 21:35:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:35:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:35:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:35:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:35:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:35:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:35:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:35:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:35:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:35:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:35:34 [DEBUG   ] Finished updating board flags in 1.390 seconds
2013-06-18 21:35:51 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-18 21:36:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 21:36:31 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 21:36:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:36:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:36:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:36:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:36:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:36:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:36:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:36:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:36:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:36:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:36:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 21:36:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 21:36:35 [DEBUG   ] Finished updating board flags in 2.213 seconds
2013-06-18 21:36:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 21:37:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 21:37:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-18 21:37:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:37:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:37:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:37:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:37:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:37:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:37:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:37:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:37:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:37:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:37:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 21:37:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 21:37:35 [DEBUG   ] Finished updating board flags in 2.191 seconds
2013-06-18 21:37:40 [DEBUG   ] Got command RPT from MCS: ref #9715
2013-06-18 21:37:40 [DEBUG   ] summary = ERROR
2013-06-18 21:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9715  13 56461 77860585 A  ERRORERROR'
2013-06-18 21:37:40 [DEBUG   ] Got command RPT from MCS: ref #9716
2013-06-18 21:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 21:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9716  77 56461 77860586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 21:37:52 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-18 21:38:12 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-18 21:38:32 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-18 21:38:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:38:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:38:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:38:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:38:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:38:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:38:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:38:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:38:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:38:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:38:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 21:38:35 [DEBUG   ] Finished updating board flags in 2.011 seconds
2013-06-18 21:38:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 21:39:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 21:39:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 21:39:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:39:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:39:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:39:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:39:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:39:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:39:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:39:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:39:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:39:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:39:35 [DEBUG   ] Finished updating board flags in 1.987 seconds
2013-06-18 21:39:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 21:40:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 21:40:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 21:40:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:40:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:40:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:40:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:40:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:40:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:40:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:40:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:40:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:40:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:40:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 21:40:35 [DEBUG   ] Finished updating board flags in 1.832 seconds
2013-06-18 21:40:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 21:41:12 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 21:41:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 21:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:41:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:41:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:41:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 21:41:35 [DEBUG   ] Finished updating board flags in 1.783 seconds
2013-06-18 21:41:52 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2013-06-18 21:42:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 21:42:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 21:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:42:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:42:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:42:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 21:42:35 [DEBUG   ] Finished updating board flags in 1.606 seconds
2013-06-18 21:42:40 [DEBUG   ] Got command RPT from MCS: ref #9732
2013-06-18 21:42:40 [DEBUG   ] summary = ERROR
2013-06-18 21:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9732  13 56461 78160585 A  ERRORERROR'
2013-06-18 21:42:40 [DEBUG   ] Got command RPT from MCS: ref #9733
2013-06-18 21:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 21:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9733  77 56461 78160586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 21:42:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 21:43:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 21:43:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-18 21:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:43:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:43:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:43:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:43:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:43:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:43:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:43:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 21:43:35 [DEBUG   ] Finished updating board flags in 1.608 seconds
2013-06-18 21:43:53 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-18 21:44:13 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 21:44:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 21:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:44:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:44:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:44:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:44:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:44:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:44:35 [DEBUG   ] Finished updating board flags in 1.594 seconds
2013-06-18 21:44:53 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-18 21:45:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 21:45:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 21:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:45:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:45:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:45:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:45:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:45:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:45:35 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 21:45:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 21:45:35 [DEBUG   ] Finished updating board flags in 1.415 seconds
2013-06-18 21:45:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 21:46:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 21:46:33 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 21:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:46:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:46:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:46:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:46:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:46:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:46:35 [DEBUG   ] Finished updating board flags in 1.409 seconds
2013-06-18 21:46:53 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 21:47:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 21:47:33 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-18 21:47:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:47:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:47:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:47:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:47:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:47:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:47:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:47:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:47:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:47:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:47:35 [DEBUG   ] Finished updating board flags in 1.391 seconds
2013-06-18 21:47:40 [DEBUG   ] Got command RPT from MCS: ref #9749
2013-06-18 21:47:40 [DEBUG   ] summary = ERROR
2013-06-18 21:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9749  13 56461 78460585 A  ERRORERROR'
2013-06-18 21:47:40 [DEBUG   ] Got command RPT from MCS: ref #9750
2013-06-18 21:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 21:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9750  77 56461 78460586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 21:47:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 21:48:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 21:48:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 21:48:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:48:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:48:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:48:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:48:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:48:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:48:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:48:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:48:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:48:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:48:36 [DEBUG   ] Finished updating board flags in 2.235 seconds
2013-06-18 21:48:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 21:49:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 21:49:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 21:49:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:49:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:49:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:49:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:49:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:49:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:49:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:49:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:49:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:49:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:49:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 21:49:36 [DEBUG   ] Finished updating board flags in 2.157 seconds
2013-06-18 21:49:54 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-18 21:50:14 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 21:50:34 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 21:50:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:50:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:50:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:50:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:50:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:50:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:50:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:50:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:50:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:50:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:50:36 [DEBUG   ] Finished updating board flags in 2.011 seconds
2013-06-18 21:50:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 21:51:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 21:51:34 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-18 21:51:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:51:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:51:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:51:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:51:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:51:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:51:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:51:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:51:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:51:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:51:36 [DEBUG   ] Finished updating board flags in 1.990 seconds
2013-06-18 21:51:54 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 21:52:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 21:52:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 21:52:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:52:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:52:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:52:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:52:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:52:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:52:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:52:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:52:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:52:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:52:36 [DEBUG   ] Finished updating board flags in 1.850 seconds
2013-06-18 21:52:40 [DEBUG   ] Got command RPT from MCS: ref #9766
2013-06-18 21:52:40 [DEBUG   ] summary = ERROR
2013-06-18 21:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9766  13 56461 78760581 A  ERRORERROR'
2013-06-18 21:52:40 [DEBUG   ] Got command RPT from MCS: ref #9767
2013-06-18 21:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 21:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9767  77 56461 78760582 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 21:52:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 21:53:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 21:53:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 21:53:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:53:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:53:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:53:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:53:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:53:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:53:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:53:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:53:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:53:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:53:36 [DEBUG   ] Finished updating board flags in 1.758 seconds
2013-06-18 21:53:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 21:54:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 21:54:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 21:54:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:54:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:54:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:54:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:54:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:54:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:54:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:54:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:54:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:54:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:54:36 [DEBUG   ] Finished updating board flags in 1.636 seconds
2013-06-18 21:54:55 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-18 21:55:15 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 21:55:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:55:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:55:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:55:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:55:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:55:35 [DEBUG   ] Finished updating ant stats in 1.247 seconds
2013-06-18 21:55:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:55:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:55:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:55:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:55:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:55:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 21:55:36 [DEBUG   ] Finished updating board flags in 1.567 seconds
2013-06-18 21:55:55 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2013-06-18 21:56:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 21:56:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:56:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:56:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:56:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:56:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:56:35 [DEBUG   ] Finished updating ant stats in 1.051 seconds
2013-06-18 21:56:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:56:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:56:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:56:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:56:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:56:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 21:56:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 21:56:36 [DEBUG   ] Finished updating board flags in 1.445 seconds
2013-06-18 21:56:55 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2013-06-18 21:57:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 21:57:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 21:57:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:57:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:57:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:57:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:57:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:57:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:57:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:57:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:57:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:57:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:57:36 [DEBUG   ] Finished updating board flags in 1.391 seconds
2013-06-18 21:57:40 [DEBUG   ] Got command RPT from MCS: ref #9783
2013-06-18 21:57:40 [DEBUG   ] summary = ERROR
2013-06-18 21:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9783  13 56461 79060589 A  ERRORERROR'
2013-06-18 21:57:40 [DEBUG   ] Got command RPT from MCS: ref #9784
2013-06-18 21:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 21:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9784  77 56461 79060590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 21:57:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 21:58:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 21:58:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 21:58:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:58:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:58:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:58:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:58:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:58:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:58:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:58:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:58:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:58:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:58:37 [DEBUG   ] Finished updating board flags in 2.189 seconds
2013-06-18 21:58:55 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 21:59:15 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2013-06-18 21:59:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 21:59:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 21:59:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 21:59:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 21:59:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 21:59:36 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-18 21:59:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 21:59:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 21:59:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 21:59:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 21:59:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 21:59:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 21:59:37 [DEBUG   ] Finished updating board flags in 1.996 seconds
2013-06-18 21:59:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 22:00:16 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2013-06-18 22:00:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:00:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:00:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:00:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:00:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:00:36 [DEBUG   ] Finished updating ant stats in 1.048 seconds
2013-06-18 22:00:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:00:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:00:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:00:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:00:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:00:37 [DEBUG   ] Finished updating board flags in 1.804 seconds
2013-06-18 22:00:56 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2013-06-18 22:01:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:01:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:01:36 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2013-06-18 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:01:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:01:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 22:01:37 [DEBUG   ] Finished updating board flags in 1.801 seconds
2013-06-18 22:01:56 [DEBUG   ] Finished updating ant stats in 0.755 seconds
2013-06-18 22:02:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:02:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:02:36 [DEBUG   ] Finished updating ant stats in 0.651 seconds
2013-06-18 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:02:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:02:37 [DEBUG   ] Finished updating board flags in 1.801 seconds
2013-06-18 22:02:40 [DEBUG   ] Got command RPT from MCS: ref #9800
2013-06-18 22:02:40 [DEBUG   ] summary = ERROR
2013-06-18 22:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9800  13 56461 79360589 A  ERRORERROR'
2013-06-18 22:02:40 [DEBUG   ] Got command RPT from MCS: ref #9801
2013-06-18 22:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 22:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9801  77 56461 79360590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 22:02:56 [DEBUG   ] Finished updating ant stats in 0.555 seconds
2013-06-18 22:03:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-18 22:03:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:03:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:03:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:03:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:03:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:03:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 22:03:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:03:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:03:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:03:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:03:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:03:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 22:03:37 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-18 22:03:37 [DEBUG   ] Finished updating board flags in 1.797 seconds
2013-06-18 22:03:57 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 22:04:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 22:04:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:04:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:04:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:04:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:04:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:04:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:04:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:04:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:04:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:04:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:04:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 22:04:37 [DEBUG   ] Finished updating ant stats in 1.249 seconds
2013-06-18 22:04:37 [DEBUG   ] Finished updating board flags in 1.668 seconds
2013-06-18 22:04:57 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2013-06-18 22:05:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 22:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:05:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:05:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:05:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:05:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:05:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:05:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:05:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 22:05:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-18 22:05:37 [DEBUG   ] Finished updating ant stats in 0.846 seconds
2013-06-18 22:05:37 [DEBUG   ] Finished updating board flags in 1.586 seconds
2013-06-18 22:05:57 [DEBUG   ] Finished updating ant stats in 0.761 seconds
2013-06-18 22:06:17 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 22:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:06:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:06:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:06:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:06:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:06:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:06:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:06:37 [DEBUG   ] Finished updating ant stats in 0.639 seconds
2013-06-18 22:06:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 22:06:37 [DEBUG   ] Finished updating board flags in 1.476 seconds
2013-06-18 22:06:57 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2013-06-18 22:07:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-18 22:07:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:07:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:07:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:07:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:07:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:07:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:07:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:07:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:07:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:07:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:07:38 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-18 22:07:38 [DEBUG   ] Finished updating board flags in 2.281 seconds
2013-06-18 22:07:40 [DEBUG   ] Got command RPT from MCS: ref #9817
2013-06-18 22:07:40 [DEBUG   ] summary = ERROR
2013-06-18 22:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9817  13 56461 79660589 A  ERRORERROR'
2013-06-18 22:07:40 [DEBUG   ] Got command RPT from MCS: ref #9818
2013-06-18 22:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 22:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9818  77 56461 79660590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 22:07:58 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-18 22:08:18 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 22:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:08:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:08:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:08:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:08:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:08:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:08:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:08:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 22:08:38 [DEBUG   ] Finished updating ant stats in 1.244 seconds
2013-06-18 22:08:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 22:08:38 [DEBUG   ] Finished updating board flags in 2.269 seconds
2013-06-18 22:08:58 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2013-06-18 22:09:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 22:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:09:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:09:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:09:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:09:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:09:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:09:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:09:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 22:09:38 [DEBUG   ] Finished updating ant stats in 1.042 seconds
2013-06-18 22:09:38 [DEBUG   ] Finished updating board flags in 2.183 seconds
2013-06-18 22:09:58 [DEBUG   ] Finished updating ant stats in 0.960 seconds
2013-06-18 22:10:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 22:10:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:10:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:10:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:10:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:10:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:10:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:10:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:10:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:10:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:10:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:10:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 22:10:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 22:10:38 [DEBUG   ] Finished updating ant stats in 0.646 seconds
2013-06-18 22:10:38 [DEBUG   ] Finished updating board flags in 2.029 seconds
2013-06-18 22:10:58 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2013-06-18 22:11:18 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-18 22:11:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:11:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:11:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:11:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:11:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:11:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:11:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:11:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:11:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:11:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:11:38 [DEBUG   ] Finished updating board flags in 1.972 seconds
2013-06-18 22:11:39 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-18 22:11:59 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 22:12:19 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 22:12:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:12:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:12:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:12:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:12:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:12:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:12:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:12:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:12:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:12:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:12:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 22:12:39 [DEBUG   ] Finished updating board flags in 2.898 seconds
2013-06-18 22:12:40 [DEBUG   ] Got command RPT from MCS: ref #9834
2013-06-18 22:12:40 [DEBUG   ] summary = ERROR
2013-06-18 22:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9834  13 56461 79960593 A  ERRORERROR'
2013-06-18 22:12:40 [DEBUG   ] Got command RPT from MCS: ref #9835
2013-06-18 22:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 22:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9835  77 56461 79960594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 22:12:59 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-18 22:13:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 22:13:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:13:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:13:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:13:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:13:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:13:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:13:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:13:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:13:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:13:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:13:38 [DEBUG   ] Finished updating board flags in 1.720 seconds
2013-06-18 22:13:39 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 22:13:59 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-18 22:14:19 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2013-06-18 22:14:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:14:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:14:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:14:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:14:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:14:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:14:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:14:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:14:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:14:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:14:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 22:14:38 [DEBUG   ] Finished updating board flags in 1.550 seconds
2013-06-18 22:14:40 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 22:15:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 22:15:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 22:15:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:15:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:15:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:15:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:15:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:15:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:15:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:15:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:15:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:15:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:15:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 22:15:38 [DEBUG   ] Finished updating board flags in 1.406 seconds
2013-06-18 22:15:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 22:16:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 22:16:20 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-18 22:16:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:16:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:16:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:16:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:16:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:16:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:16:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:16:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:16:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:16:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:16:38 [DEBUG   ] Finished updating board flags in 1.379 seconds
2013-06-18 22:16:40 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2013-06-18 22:17:00 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-18 22:17:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 22:17:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:17:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:17:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:17:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:17:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:17:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-18 22:17:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:17:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:17:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:17:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:17:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:17:39 [DEBUG   ] Finished updating board flags in 2.220 seconds
2013-06-18 22:17:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-18 22:17:40 [DEBUG   ] Got command RPT from MCS: ref #9851
2013-06-18 22:17:40 [DEBUG   ] summary = ERROR
2013-06-18 22:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9851  13 56461 80260585 A  ERRORERROR'
2013-06-18 22:17:40 [DEBUG   ] Got command RPT from MCS: ref #9852
2013-06-18 22:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 22:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9852  77 56461 80260586 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 22:18:01 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-06-18 22:18:20 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-18 22:18:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:18:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:18:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:18:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:18:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:18:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:18:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:18:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:18:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:18:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:18:39 [DEBUG   ] Finished updating board flags in 2.190 seconds
2013-06-18 22:18:40 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2013-06-18 22:19:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-18 22:19:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 22:19:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:19:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:19:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:19:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:19:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:19:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:19:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:19:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:19:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:19:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:19:39 [DEBUG   ] Finished updating board flags in 2.018 seconds
2013-06-18 22:19:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 22:20:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-18 22:20:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 22:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:20:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:20:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:20:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:20:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:20:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:20:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:20:39 [DEBUG   ] Finished updating board flags in 1.984 seconds
2013-06-18 22:20:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 22:21:01 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 22:21:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 22:21:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:21:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:21:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:21:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:21:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:21:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:21:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:21:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:21:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:21:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:21:39 [DEBUG   ] Finished updating board flags in 1.820 seconds
2013-06-18 22:21:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 22:22:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-18 22:22:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 22:22:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:22:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:22:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:22:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:22:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:22:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:22:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:22:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:22:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:22:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:22:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 22:22:39 [DEBUG   ] Finished updating board flags in 1.786 seconds
2013-06-18 22:22:40 [DEBUG   ] Got command RPT from MCS: ref #9868
2013-06-18 22:22:40 [DEBUG   ] summary = ERROR
2013-06-18 22:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9868  13 56461 80560593 A  ERRORERROR'
2013-06-18 22:22:40 [DEBUG   ] Got command RPT from MCS: ref #9869
2013-06-18 22:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 22:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9869  77 56461 80560594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 22:22:41 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-18 22:23:02 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-18 22:23:22 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-18 22:23:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:23:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:23:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:23:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:23:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:23:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:23:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:23:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:23:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:23:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:23:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-18 22:23:39 [DEBUG   ] Finished updating board flags in 1.615 seconds
2013-06-18 22:23:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 22:24:02 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-18 22:24:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 22:24:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:24:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:24:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:24:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:24:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:24:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:24:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:24:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:24:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:24:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:24:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 22:24:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 22:24:39 [DEBUG   ] Finished updating board flags in 1.598 seconds
2013-06-18 22:24:42 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 22:25:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 22:25:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 22:25:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:25:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:25:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:25:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:25:38 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:25:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:25:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:25:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:25:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:25:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:25:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 22:25:39 [DEBUG   ] Finished updating board flags in 1.397 seconds
2013-06-18 22:25:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 22:26:02 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 22:26:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 22:26:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:26:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:26:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:26:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:26:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:26:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:26:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:26:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:26:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:26:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:26:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 22:26:40 [DEBUG   ] Finished updating board flags in 2.211 seconds
2013-06-18 22:26:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 22:27:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 22:27:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 22:27:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:27:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:27:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:27:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:27:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:27:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:27:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:27:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:27:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:27:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:27:40 [DEBUG   ] Got command RPT from MCS: ref #9885
2013-06-18 22:27:40 [DEBUG   ] summary = ERROR
2013-06-18 22:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9885  13 56461 80860593 A  ERRORERROR'
2013-06-18 22:27:40 [DEBUG   ] Got command RPT from MCS: ref #9886
2013-06-18 22:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 22:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9886  77 56461 80860594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 22:27:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 22:27:40 [DEBUG   ] Finished updating board flags in 2.190 seconds
2013-06-18 22:27:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 22:28:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 22:28:22 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 22:28:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:28:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:28:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:28:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:28:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:28:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:28:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:28:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:28:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:28:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:28:40 [DEBUG   ] Finished updating board flags in 2.009 seconds
2013-06-18 22:28:42 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 22:29:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-18 22:29:23 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-18 22:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:29:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:29:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:29:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:29:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:29:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:29:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:29:40 [DEBUG   ] Finished updating board flags in 2.002 seconds
2013-06-18 22:29:43 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-18 22:30:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 22:30:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 22:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:30:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:30:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:30:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:30:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:30:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:30:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:30:40 [DEBUG   ] Finished updating board flags in 1.993 seconds
2013-06-18 22:30:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 22:31:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-18 22:31:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:31:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:31:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:31:40 [DEBUG   ] Finished updating board flags in 1.807 seconds
2013-06-18 22:31:43 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 22:32:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 22:32:23 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2013-06-18 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:32:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:32:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:32:40 [DEBUG   ] Got command RPT from MCS: ref #9902
2013-06-18 22:32:40 [DEBUG   ] summary = ERROR
2013-06-18 22:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9902  13 56461 81160601 A  ERRORERROR'
2013-06-18 22:32:40 [DEBUG   ] Got command RPT from MCS: ref #9903
2013-06-18 22:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 22:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9903  77 56461 81160602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 22:32:40 [DEBUG   ] Finished updating board flags in 1.816 seconds
2013-06-18 22:32:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 22:33:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 22:33:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:33:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:33:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:33:40 [DEBUG   ] Finished updating board flags in 1.784 seconds
2013-06-18 22:33:43 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2013-06-18 22:34:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 22:34:23 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:34:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:34:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:34:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 22:34:40 [DEBUG   ] Finished updating board flags in 1.621 seconds
2013-06-18 22:34:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 22:35:03 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-18 22:35:24 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-18 22:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:35:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:35:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:35:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:35:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:35:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:35:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:35:40 [DEBUG   ] Finished updating board flags in 1.586 seconds
2013-06-18 22:35:43 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-18 22:36:03 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-18 22:36:24 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-18 22:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:36:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:36:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:36:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:36:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:36:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:36:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:36:40 [DEBUG   ] Finished updating board flags in 1.445 seconds
2013-06-18 22:36:44 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-18 22:37:04 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-18 22:37:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 22:37:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:37:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:37:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:37:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:37:39 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:37:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:37:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:37:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:37:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:37:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:37:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-06-18 22:37:40 [DEBUG   ] Got command RPT from MCS: ref #9919
2013-06-18 22:37:40 [DEBUG   ] summary = ERROR
2013-06-18 22:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9919  13 56461 81460593 A  ERRORERROR'
2013-06-18 22:37:40 [DEBUG   ] Got command RPT from MCS: ref #9920
2013-06-18 22:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 22:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9920  77 56461 81460594 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 22:37:40 [DEBUG   ] Finished updating board flags in 1.426 seconds
2013-06-18 22:37:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 22:38:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 22:38:24 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 22:38:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:38:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:38:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:38:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:38:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:38:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:38:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:38:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:38:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:38:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:38:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 22:38:41 [DEBUG   ] Finished updating board flags in 2.417 seconds
2013-06-18 22:38:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 22:39:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 22:39:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 22:39:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:39:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:39:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:39:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:39:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:39:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:39:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:39:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:39:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:39:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:39:41 [DEBUG   ] Finished updating board flags in 2.323 seconds
2013-06-18 22:39:44 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-18 22:40:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 22:40:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 22:40:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:40:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:40:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:40:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:40:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:40:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:40:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:40:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:40:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:40:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:40:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 22:40:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-06-18 22:40:41 [DEBUG   ] Finished updating board flags in 2.223 seconds
2013-06-18 22:40:44 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-18 22:41:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 22:41:25 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-18 22:41:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:41:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:41:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:41:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:41:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:41:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:41:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:41:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:41:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:41:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:41:41 [DEBUG   ] Finished updating board flags in 2.186 seconds
2013-06-18 22:41:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 22:42:05 [DEBUG   ] Finished updating ant stats in 1.192 seconds
2013-06-18 22:42:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 22:42:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:42:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:42:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:42:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:42:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:42:40 [DEBUG   ] Got command RPT from MCS: ref #9936
2013-06-18 22:42:40 [DEBUG   ] summary = ERROR
2013-06-18 22:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9936  13 56461 81760607 A  ERRORERROR'
2013-06-18 22:42:40 [DEBUG   ] Got command RPT from MCS: ref #9937
2013-06-18 22:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 22:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9937  77 56461 81760607 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 22:42:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:42:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:42:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:42:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:42:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:42:41 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 22:42:41 [DEBUG   ] Finished updating board flags in 2.009 seconds
2013-06-18 22:42:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 22:43:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 22:43:25 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-18 22:43:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:43:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:43:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:43:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:43:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:43:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:43:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:43:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:43:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:43:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:43:41 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 22:43:41 [DEBUG   ] Finished updating board flags in 2.044 seconds
2013-06-18 22:43:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 22:44:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 22:44:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 22:44:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:44:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:44:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:44:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:44:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:44:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:44:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:44:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:44:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:44:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:44:41 [DEBUG   ] Finished updating board flags in 1.945 seconds
2013-06-18 22:44:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 22:45:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 22:45:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 22:45:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:45:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:45:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:45:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:45:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:45:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:45:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:45:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:45:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:45:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:45:41 [DEBUG   ] Finished updating board flags in 1.814 seconds
2013-06-18 22:45:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 22:46:05 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 22:46:26 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-18 22:46:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:46:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:46:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:46:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:46:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:46:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:46:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:46:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:46:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:46:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:46:41 [DEBUG   ] Finished updating board flags in 1.798 seconds
2013-06-18 22:46:46 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-18 22:47:06 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2013-06-18 22:47:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 22:47:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:47:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:47:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:47:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:47:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:47:40 [DEBUG   ] Got command RPT from MCS: ref #9953
2013-06-18 22:47:40 [DEBUG   ] summary = ERROR
2013-06-18 22:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9953  13 56461 82060601 A  ERRORERROR'
2013-06-18 22:47:40 [DEBUG   ] Got command RPT from MCS: ref #9954
2013-06-18 22:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 22:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9954  77 56461 82060602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 22:47:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:47:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:47:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:47:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:47:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:47:41 [DEBUG   ] Finished updating board flags in 1.594 seconds
2013-06-18 22:47:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 22:48:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 22:48:26 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2013-06-18 22:48:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:48:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:48:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:48:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:48:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:48:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:48:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:48:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:48:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:48:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:48:41 [DEBUG   ] Finished updating board flags in 1.412 seconds
2013-06-18 22:48:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 22:49:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 22:49:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-18 22:49:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:49:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:49:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:49:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:49:40 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:49:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:49:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:49:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:49:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:49:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:49:41 [DEBUG   ] Finished updating board flags in 1.388 seconds
2013-06-18 22:49:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 22:50:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 22:50:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 22:50:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:50:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:50:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:50:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:50:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:50:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:50:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:50:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:50:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:50:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:50:42 [DEBUG   ] Finished updating board flags in 2.212 seconds
2013-06-18 22:50:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 22:51:06 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-18 22:51:26 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-18 22:51:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:51:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:51:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:51:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:51:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:51:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:51:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:51:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:51:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:51:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:51:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 22:51:42 [DEBUG   ] Finished updating board flags in 2.206 seconds
2013-06-18 22:51:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-18 22:52:07 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-18 22:52:27 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-18 22:52:40 [DEBUG   ] Got command RPT from MCS: ref #9970
2013-06-18 22:52:40 [DEBUG   ] summary = ERROR
2013-06-18 22:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9970  13 56461 82360605 A  ERRORERROR'
2013-06-18 22:52:40 [DEBUG   ] Got command RPT from MCS: ref #9971
2013-06-18 22:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 22:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9971  77 56461 82360606 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 22:52:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:52:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:52:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:52:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:52:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:52:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:52:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:52:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:52:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:52:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:52:42 [DEBUG   ] Finished updating board flags in 2.192 seconds
2013-06-18 22:52:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 22:53:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 22:53:27 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-18 22:53:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:53:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:53:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:53:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:53:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:53:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:53:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:53:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:53:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:53:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:53:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 22:53:42 [DEBUG   ] Finished updating board flags in 2.016 seconds
2013-06-18 22:53:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 22:54:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 22:54:27 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 22:54:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:54:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:54:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:54:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:54:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:54:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:54:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:54:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:54:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:54:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:54:42 [DEBUG   ] Finished updating board flags in 1.995 seconds
2013-06-18 22:54:47 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-18 22:55:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 22:55:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 22:55:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:55:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:55:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:55:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:55:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:55:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:55:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:55:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:55:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:55:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:55:42 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 22:55:42 [DEBUG   ] Finished updating board flags in 1.800 seconds
2013-06-18 22:55:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 22:56:07 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-18 22:56:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 22:56:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:56:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:56:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:56:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:56:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:56:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:56:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:56:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:56:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:56:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:56:42 [DEBUG   ] Finished updating board flags in 1.792 seconds
2013-06-18 22:56:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 22:57:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 22:57:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 22:57:40 [DEBUG   ] Got command RPT from MCS: ref #9987
2013-06-18 22:57:40 [DEBUG   ] summary = ERROR
2013-06-18 22:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9987  13 56461 82660597 A  ERRORERROR'
2013-06-18 22:57:40 [DEBUG   ] Got command RPT from MCS: ref #9988
2013-06-18 22:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 22:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT     9988  77 56461 82660598 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 22:57:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:57:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:57:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:57:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:57:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:57:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:57:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:57:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:57:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:57:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:57:42 [DEBUG   ] Finished updating board flags in 1.622 seconds
2013-06-18 22:57:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 22:58:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 22:58:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 22:58:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:58:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:58:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:58:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:58:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:58:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:58:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:58:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:58:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:58:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:58:42 [DEBUG   ] Finished updating board flags in 1.618 seconds
2013-06-18 22:58:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 22:59:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 22:59:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 22:59:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 22:59:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 22:59:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 22:59:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 22:59:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 22:59:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 22:59:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 22:59:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 22:59:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 22:59:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 22:59:42 [DEBUG   ] Finished updating board flags in 1.692 seconds
2013-06-18 22:59:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 23:00:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 23:00:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 23:00:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 23:00:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 23:00:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 23:00:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 23:00:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 23:00:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 23:00:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 23:00:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 23:00:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 23:00:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 23:00:42 [DEBUG   ] Finished updating board flags in 1.503 seconds
2013-06-18 23:00:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 23:01:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 23:01:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 23:01:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 23:01:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 23:01:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 23:01:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 23:01:41 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 23:01:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 23:01:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 23:01:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 23:01:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 23:01:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 23:01:42 [DEBUG   ] Finished updating board flags in 1.526 seconds
2013-06-18 23:01:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 23:02:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 23:02:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 23:02:40 [DEBUG   ] Got command RPT from MCS: ref #10004
2013-06-18 23:02:40 [DEBUG   ] summary = ERROR
2013-06-18 23:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10004  13 56461 82960601 A  ERRORERROR'
2013-06-18 23:02:40 [DEBUG   ] Got command RPT from MCS: ref #10005
2013-06-18 23:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 23:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10005  77 56461 82960602 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 23:02:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 23:02:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 23:02:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 23:02:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 23:02:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 23:02:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 23:02:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 23:02:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 23:02:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 23:02:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 23:02:43 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 23:02:43 [DEBUG   ] Finished updating board flags in 2.304 seconds
2013-06-18 23:02:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 23:03:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 23:03:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 23:03:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 23:03:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 23:03:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 23:03:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 23:03:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 23:03:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 23:03:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 23:03:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 23:03:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 23:03:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 23:03:43 [DEBUG   ] Finished updating board flags in 2.152 seconds
2013-06-18 23:03:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 23:04:07 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-18 23:04:28 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-18 23:04:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 23:04:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 23:04:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 23:04:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 23:04:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 23:04:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 23:04:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 23:04:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 23:04:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 23:04:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 23:04:43 [DEBUG   ] Finished updating board flags in 2.017 seconds
2013-06-18 23:04:48 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-18 23:05:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 23:05:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 23:05:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 23:05:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 23:05:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 23:05:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 23:05:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 23:05:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 23:05:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 23:05:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 23:05:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 23:05:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 23:05:43 [DEBUG   ] Finished updating board flags in 2.002 seconds
2013-06-18 23:05:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 23:06:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 23:06:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 23:06:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 23:06:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 23:06:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 23:06:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 23:06:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 23:06:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 23:06:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 23:06:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 23:06:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 23:06:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 23:06:43 [DEBUG   ] Finished updating board flags in 2.079 seconds
2013-06-18 23:06:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 23:07:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 23:07:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 23:07:40 [DEBUG   ] Got command RPT from MCS: ref #10021
2013-06-18 23:07:40 [DEBUG   ] summary = ERROR
2013-06-18 23:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10021  13 56461 83260609 A  ERRORERROR'
2013-06-18 23:07:40 [DEBUG   ] Got command RPT from MCS: ref #10022
2013-06-18 23:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 23:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10022  77 56461 83260610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 23:07:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 23:07:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 23:07:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 23:07:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 23:07:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 23:07:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 23:07:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 23:07:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 23:07:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 23:07:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 23:07:43 [DEBUG   ] Finished updating board flags in 1.910 seconds
2013-06-18 23:07:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 23:08:08 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 23:08:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 23:08:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-18 23:08:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-18 23:08:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-18 23:08:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-18 23:08:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-18 23:08:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-18 23:08:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-18 23:08:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-18 23:08:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-18 23:08:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-18 23:08:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 23:08:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 23:08:43 [DEBUG   ] Finished updating board flags in 1.802 seconds
2013-06-18 23:08:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 23:09:08 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 23:09:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-18 23:09:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-18 23:09:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-18 23:09:43 [DEBUG   ] Finished updating board flags in 1.843 seconds
2013-06-18 23:09:48 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 23:10:08 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 23:10:28 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-18 23:10:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-18 23:10:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-18 23:10:43 [DEBUG   ] Finished updating board flags in 1.759 seconds
2013-06-18 23:10:48 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 23:11:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 23:11:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 23:11:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-18 23:11:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-18 23:11:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-18 23:11:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-18 23:11:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-18 23:11:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-18 23:11:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-18 23:11:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-18 23:11:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-18 23:11:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-18 23:11:43 [DEBUG   ] Finished updating board flags in 1.648 seconds
2013-06-18 23:11:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 23:12:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 23:12:28 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 23:12:40 [DEBUG   ] Got command RPT from MCS: ref #10038
2013-06-18 23:12:40 [DEBUG   ] summary = ERROR
2013-06-18 23:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10038  13 56461 83560613 A  ERRORERROR'
2013-06-18 23:12:40 [DEBUG   ] Got command RPT from MCS: ref #10039
2013-06-18 23:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 23:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10039  77 56461 83560614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 23:12:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-18 23:12:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-18 23:12:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-18 23:12:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-18 23:12:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-18 23:12:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-18 23:12:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-18 23:12:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-18 23:12:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-18 23:12:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-18 23:12:43 [DEBUG   ] Finished updating board flags in 1.653 seconds
2013-06-18 23:12:48 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-18 23:13:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 23:13:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 23:13:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-18 23:13:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-18 23:13:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-18 23:13:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-18 23:13:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-18 23:13:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-18 23:13:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-18 23:13:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-18 23:13:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-18 23:13:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-18 23:13:43 [DEBUG   ] Finished updating board flags in 1.513 seconds
2013-06-18 23:13:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 23:14:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 23:14:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 23:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-18 23:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-18 23:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-18 23:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-18 23:14:42 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-18 23:14:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-18 23:14:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-18 23:14:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-18 23:14:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-18 23:14:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-18 23:14:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 23:14:43 [DEBUG   ] Finished updating board flags in 1.400 seconds
2013-06-18 23:14:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 23:15:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 23:15:28 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2013-06-18 23:15:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-18 23:15:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-18 23:15:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-18 23:15:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-18 23:15:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-18 23:15:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-18 23:15:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-18 23:15:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-18 23:15:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-18 23:15:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-18 23:15:44 [DEBUG   ] Finished updating board flags in 2.207 seconds
2013-06-18 23:15:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 23:16:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 23:16:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 23:16:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-18 23:16:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-18 23:16:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-18 23:16:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-18 23:16:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-18 23:16:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-18 23:16:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-18 23:16:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-18 23:16:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-18 23:16:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-18 23:16:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 23:16:44 [DEBUG   ] Finished updating board flags in 2.193 seconds
2013-06-18 23:16:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 23:17:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 23:17:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 23:17:40 [DEBUG   ] Got command RPT from MCS: ref #10055
2013-06-18 23:17:40 [DEBUG   ] summary = ERROR
2013-06-18 23:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10055  13 56461 83860613 A  ERRORERROR'
2013-06-18 23:17:40 [DEBUG   ] Got command RPT from MCS: ref #10056
2013-06-18 23:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 23:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10056  77 56461 83860614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 23:17:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-18 23:17:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-18 23:17:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-18 23:17:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-18 23:17:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-18 23:17:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-18 23:17:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-18 23:17:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-18 23:17:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-18 23:17:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-18 23:17:44 [DEBUG   ] Finished updating board flags in 2.038 seconds
2013-06-18 23:17:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 23:18:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 23:18:28 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 23:18:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-18 23:18:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-18 23:18:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-18 23:18:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-18 23:18:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-18 23:18:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-18 23:18:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-18 23:18:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-18 23:18:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-18 23:18:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-18 23:18:44 [DEBUG   ] Finished updating board flags in 2.068 seconds
2013-06-18 23:18:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 23:19:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 23:19:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 23:19:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-18 23:19:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-18 23:19:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-18 23:19:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-18 23:19:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-18 23:19:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-18 23:19:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-18 23:19:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-18 23:19:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-18 23:19:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-18 23:19:44 [DEBUG   ] Finished updating board flags in 1.907 seconds
2013-06-18 23:19:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 23:20:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 23:20:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 23:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-18 23:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-18 23:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-18 23:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-18 23:20:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-18 23:20:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-18 23:20:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-18 23:20:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-18 23:20:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-18 23:20:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-18 23:20:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 23:20:44 [DEBUG   ] Finished updating board flags in 1.810 seconds
2013-06-18 23:20:48 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-18 23:21:08 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 23:21:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 23:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-18 23:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-18 23:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-18 23:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-18 23:21:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-18 23:21:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-18 23:21:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-18 23:21:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-18 23:21:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-18 23:21:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-18 23:21:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 23:21:44 [DEBUG   ] Finished updating board flags in 1.801 seconds
2013-06-18 23:21:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 23:22:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 23:22:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 23:22:40 [DEBUG   ] Got command RPT from MCS: ref #10072
2013-06-18 23:22:40 [DEBUG   ] summary = ERROR
2013-06-18 23:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10072  13 56461 84160609 A  ERRORERROR'
2013-06-18 23:22:40 [DEBUG   ] Got command RPT from MCS: ref #10073
2013-06-18 23:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 23:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10073  77 56461 84160610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 23:22:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-18 23:22:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-18 23:22:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-18 23:22:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-18 23:22:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-18 23:22:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-18 23:22:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-18 23:22:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-18 23:22:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-18 23:22:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-18 23:22:44 [DEBUG   ] Finished updating board flags in 1.785 seconds
2013-06-18 23:22:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 23:23:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 23:23:28 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-18 23:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-18 23:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-18 23:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-18 23:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-18 23:23:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-18 23:23:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-18 23:23:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-18 23:23:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-18 23:23:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-18 23:23:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-18 23:23:44 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 23:23:44 [DEBUG   ] Finished updating board flags in 1.617 seconds
2013-06-18 23:23:48 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2013-06-18 23:24:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 23:24:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 23:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-18 23:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-18 23:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-18 23:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-18 23:24:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-18 23:24:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-18 23:24:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-18 23:24:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-18 23:24:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-18 23:24:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-18 23:24:44 [DEBUG   ] Finished updating board flags in 1.591 seconds
2013-06-18 23:24:49 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2013-06-18 23:25:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 23:25:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 23:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-18 23:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-18 23:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-18 23:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-18 23:25:43 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-18 23:25:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-18 23:25:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-18 23:25:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-18 23:25:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-18 23:25:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-18 23:25:44 [DEBUG   ] Finished updating board flags in 1.400 seconds
2013-06-18 23:25:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 23:26:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 23:26:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-18 23:26:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-18 23:26:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-18 23:26:45 [DEBUG   ] Finished updating board flags in 2.280 seconds
2013-06-18 23:26:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 23:27:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 23:27:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 23:27:40 [DEBUG   ] Got command RPT from MCS: ref #10089
2013-06-18 23:27:40 [DEBUG   ] summary = ERROR
2013-06-18 23:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10089  13 56461 84460613 A  ERRORERROR'
2013-06-18 23:27:40 [DEBUG   ] Got command RPT from MCS: ref #10090
2013-06-18 23:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 23:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10090  77 56461 84460614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-18 23:27:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-18 23:27:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-18 23:27:45 [DEBUG   ] Finished updating board flags in 2.179 seconds
2013-06-18 23:27:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 23:28:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-18 23:28:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 23:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-18 23:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-18 23:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-18 23:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-18 23:28:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-18 23:28:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-18 23:28:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-18 23:28:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-18 23:28:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-18 23:28:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-18 23:28:45 [DEBUG   ] Finished updating board flags in 2.015 seconds
2013-06-18 23:28:49 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 23:29:09 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 23:29:29 [DEBUG   ] Finished updating ant stats in 0.784 seconds
2013-06-18 23:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-18 23:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-18 23:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-18 23:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-18 23:29:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-18 23:29:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-18 23:29:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-18 23:29:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-18 23:29:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-18 23:29:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-18 23:29:45 [DEBUG   ] Finished updating board flags in 1.925 seconds
2013-06-18 23:29:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 23:30:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 23:30:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 23:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-18 23:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-18 23:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-18 23:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-18 23:30:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-18 23:30:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-18 23:30:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-18 23:30:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-18 23:30:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-18 23:30:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-18 23:30:45 [DEBUG   ] Finished updating board flags in 1.822 seconds
2013-06-18 23:30:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 23:31:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 23:31:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 23:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-18 23:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-18 23:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-18 23:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-18 23:31:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-18 23:31:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-18 23:31:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-18 23:31:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-18 23:31:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-18 23:31:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-18 23:31:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 23:31:45 [DEBUG   ] Finished updating board flags in 1.801 seconds
2013-06-18 23:31:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 23:32:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 23:32:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 23:32:40 [DEBUG   ] Got command RPT from MCS: ref #10106
2013-06-18 23:32:40 [DEBUG   ] summary = ERROR
2013-06-18 23:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10106  13 56461 84760609 A  ERRORERROR'
2013-06-18 23:32:40 [DEBUG   ] Got command RPT from MCS: ref #10107
2013-06-18 23:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 23:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10107  77 56461 84760610 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 23:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-18 23:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-18 23:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-18 23:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-18 23:32:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-18 23:32:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-18 23:32:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-18 23:32:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-18 23:32:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-18 23:32:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-18 23:32:45 [DEBUG   ] Finished updating board flags in 1.813 seconds
2013-06-18 23:32:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 23:33:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 23:33:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 23:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-18 23:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-18 23:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-18 23:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-18 23:33:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-18 23:33:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-18 23:33:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-18 23:33:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-18 23:33:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-18 23:33:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-18 23:33:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 23:33:45 [DEBUG   ] Finished updating board flags in 1.874 seconds
2013-06-18 23:33:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 23:34:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 23:34:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-18 23:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-18 23:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-18 23:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-18 23:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-18 23:34:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-18 23:34:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-18 23:34:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-18 23:34:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-18 23:34:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-18 23:34:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-18 23:34:45 [DEBUG   ] Finished updating board flags in 1.825 seconds
2013-06-18 23:34:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 23:35:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 23:35:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 23:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-18 23:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-18 23:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-18 23:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-18 23:35:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-18 23:35:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-18 23:35:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-18 23:35:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-18 23:35:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-18 23:35:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-18 23:35:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 23:35:45 [DEBUG   ] Finished updating board flags in 1.682 seconds
2013-06-18 23:35:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 23:36:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 23:36:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 23:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-18 23:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-18 23:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-18 23:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-18 23:36:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-18 23:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-18 23:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-18 23:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-18 23:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-18 23:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-18 23:36:45 [DEBUG   ] Finished updating board flags in 1.630 seconds
2013-06-18 23:36:49 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2013-06-18 23:37:09 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-18 23:37:30 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-18 23:37:40 [DEBUG   ] Got command RPT from MCS: ref #10123
2013-06-18 23:37:40 [DEBUG   ] summary = ERROR
2013-06-18 23:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10123  13 56461 85060613 A  ERRORERROR'
2013-06-18 23:37:40 [DEBUG   ] Got command RPT from MCS: ref #10124
2013-06-18 23:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 23:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10124  77 56461 85060614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 23:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-18 23:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-18 23:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-18 23:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-18 23:37:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-18 23:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-18 23:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-18 23:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-18 23:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-18 23:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-18 23:37:45 [DEBUG   ] Finished updating board flags in 1.582 seconds
2013-06-18 23:37:50 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-18 23:38:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 23:38:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 23:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-18 23:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-18 23:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-18 23:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-18 23:38:44 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-18 23:38:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-18 23:38:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-18 23:38:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-18 23:38:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-18 23:38:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-18 23:38:45 [DEBUG   ] Finished updating board flags in 1.399 seconds
2013-06-18 23:38:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 23:39:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 23:39:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 23:39:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999019
2013-06-18 23:39:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999019
2013-06-18 23:39:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999019
2013-06-18 23:39:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999019
2013-06-18 23:39:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999019
2013-06-18 23:39:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999019
2013-06-18 23:39:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999019
2013-06-18 23:39:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999019
2013-06-18 23:39:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999019
2013-06-18 23:39:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999019
2013-06-18 23:39:46 [DEBUG   ] Finished updating board flags in 2.203 seconds
2013-06-18 23:39:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 23:40:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 23:40:30 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998725
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998705
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998705
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998705
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998705
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-18 23:40:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998705
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998627
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998627
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998627
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998627
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-18 23:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-18 23:40:46 [DEBUG   ] Finished updating board flags in 2.224 seconds
2013-06-18 23:40:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 23:41:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 23:41:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998627
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998627
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998627
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998627
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998627
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999921
2013-06-18 23:41:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999921
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998627
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998627
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998627
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998627
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998627
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-18 23:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-18 23:41:46 [DEBUG   ] Finished updating board flags in 2.275 seconds
2013-06-18 23:41:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-18 23:42:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-18 23:42:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 23:42:40 [DEBUG   ] Got command RPT from MCS: ref #10140
2013-06-18 23:42:40 [DEBUG   ] summary = ERROR
2013-06-18 23:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10140  13 56461 85360621 A  ERRORERROR'
2013-06-18 23:42:40 [DEBUG   ] Got command RPT from MCS: ref #10141
2013-06-18 23:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 23:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10141  77 56461 85360622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998627
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998627
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998627
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998627
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998627
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-18 23:42:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-18 23:42:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998627
2013-06-18 23:42:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998627
2013-06-18 23:42:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998627
2013-06-18 23:42:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998627
2013-06-18 23:42:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998627
2013-06-18 23:42:46 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 23:42:46 [DEBUG   ] Finished updating board flags in 2.130 seconds
2013-06-18 23:42:50 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-18 23:43:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 23:43:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 23:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998627
2013-06-18 23:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998627
2013-06-18 23:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998627
2013-06-18 23:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998627
2013-06-18 23:43:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998627
2013-06-18 23:43:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998627
2013-06-18 23:43:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998627
2013-06-18 23:43:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998627
2013-06-18 23:43:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998627
2013-06-18 23:43:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998627
2013-06-18 23:43:46 [DEBUG   ] Finished updating board flags in 2.015 seconds
2013-06-18 23:43:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 23:44:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 23:44:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 23:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998627
2013-06-18 23:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998627
2013-06-18 23:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998627
2013-06-18 23:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998627
2013-06-18 23:44:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998627
2013-06-18 23:44:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998627
2013-06-18 23:44:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998627
2013-06-18 23:44:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998627
2013-06-18 23:44:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998627
2013-06-18 23:44:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998627
2013-06-18 23:44:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 23:44:46 [DEBUG   ] Finished updating board flags in 1.973 seconds
2013-06-18 23:44:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 23:45:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 23:45:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 23:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998627
2013-06-18 23:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998627
2013-06-18 23:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998627
2013-06-18 23:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998627
2013-06-18 23:45:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998627
2013-06-18 23:45:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998627
2013-06-18 23:45:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998627
2013-06-18 23:45:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998627
2013-06-18 23:45:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998627
2013-06-18 23:45:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998627
2013-06-18 23:45:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-18 23:45:46 [DEBUG   ] Finished updating board flags in 1.823 seconds
2013-06-18 23:45:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 23:46:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 23:46:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998529
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998549
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998549
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998549
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998549
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-18 23:46:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998549
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998529
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998529
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998529
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998529
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-18 23:46:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-18 23:46:46 [DEBUG   ] Finished updating board flags in 1.776 seconds
2013-06-18 23:46:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 23:47:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-18 23:47:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 23:47:40 [DEBUG   ] Got command RPT from MCS: ref #10157
2013-06-18 23:47:40 [DEBUG   ] summary = ERROR
2013-06-18 23:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10157  13 56461 85660613 A  ERRORERROR'
2013-06-18 23:47:40 [DEBUG   ] Got command RPT from MCS: ref #10158
2013-06-18 23:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 23:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10158  77 56461 85660614 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998529
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998529
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998529
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998529
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998529
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-18 23:47:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998529
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998529
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998529
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998529
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998529
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-18 23:47:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-18 23:47:46 [DEBUG   ] Finished updating board flags in 1.650 seconds
2013-06-18 23:47:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 23:48:10 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2013-06-18 23:48:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998333
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998333
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998333
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998333
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998333
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-18 23:48:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998333
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998333
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998333
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998333
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998333
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-18 23:48:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-18 23:48:46 [DEBUG   ] Finished updating board flags in 1.549 seconds
2013-06-18 23:48:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-18 23:49:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 23:49:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-18 23:49:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-18 23:49:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-18 23:49:46 [DEBUG   ] Finished updating board flags in 1.541 seconds
2013-06-18 23:49:50 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-06-18 23:50:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 23:50:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 23:50:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-18 23:50:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-18 23:50:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-18 23:50:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-18 23:50:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-18 23:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-18 23:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-18 23:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-18 23:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-18 23:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-18 23:50:47 [DEBUG   ] Finished updating board flags in 2.332 seconds
2013-06-18 23:50:50 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-18 23:51:10 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2013-06-18 23:51:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-18 23:51:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-18 23:51:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-18 23:51:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-18 23:51:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-18 23:51:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-18 23:51:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-18 23:51:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-18 23:51:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-18 23:51:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-18 23:51:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-18 23:51:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 23:51:47 [DEBUG   ] Finished updating board flags in 2.134 seconds
2013-06-18 23:51:51 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2013-06-18 23:52:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 23:52:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 23:52:40 [DEBUG   ] Got command RPT from MCS: ref #10174
2013-06-18 23:52:40 [DEBUG   ] summary = ERROR
2013-06-18 23:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10174  13 56461 85960625 A  ERRORERROR'
2013-06-18 23:52:40 [DEBUG   ] Got command RPT from MCS: ref #10175
2013-06-18 23:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 23:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10175  77 56461 85960626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 23:52:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-18 23:52:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-18 23:52:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-18 23:52:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-18 23:52:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-18 23:52:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-18 23:52:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-18 23:52:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-18 23:52:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-18 23:52:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-18 23:52:47 [DEBUG   ] Finished updating board flags in 2.007 seconds
2013-06-18 23:52:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 23:53:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 23:53:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 23:53:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-18 23:53:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-18 23:53:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-18 23:53:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-18 23:53:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-18 23:53:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-18 23:53:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-18 23:53:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-18 23:53:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-18 23:53:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-18 23:53:47 [DEBUG   ] Finished updating board flags in 2.007 seconds
2013-06-18 23:53:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-18 23:54:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 23:54:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 23:54:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-18 23:54:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-18 23:54:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-18 23:54:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-18 23:54:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-18 23:54:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-18 23:54:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-18 23:54:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-18 23:54:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-18 23:54:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-18 23:54:47 [DEBUG   ] Finished updating board flags in 2.039 seconds
2013-06-18 23:54:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-18 23:55:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 23:55:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-18 23:55:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-18 23:55:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-18 23:55:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-18 23:55:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-18 23:55:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-18 23:55:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-18 23:55:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-18 23:55:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-18 23:55:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-18 23:55:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-18 23:55:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 23:55:47 [DEBUG   ] Finished updating board flags in 1.971 seconds
2013-06-18 23:55:51 [DEBUG   ] Finished updating ant stats in 0.993 seconds
2013-06-18 23:56:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 23:56:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 23:56:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-18 23:56:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-18 23:56:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-18 23:56:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-18 23:56:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-18 23:56:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-18 23:56:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-18 23:56:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-18 23:56:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-18 23:56:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-18 23:56:47 [DEBUG   ] Finished updating board flags in 1.795 seconds
2013-06-18 23:56:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-18 23:57:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 23:57:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-18 23:57:40 [DEBUG   ] Got command RPT from MCS: ref #10191
2013-06-18 23:57:40 [DEBUG   ] summary = ERROR
2013-06-18 23:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10191  13 56461 86260617 A  ERRORERROR'
2013-06-18 23:57:40 [DEBUG   ] Got command RPT from MCS: ref #10192
2013-06-18 23:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-18 23:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10192  77 56461 86260618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-18 23:57:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-18 23:57:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-18 23:57:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-18 23:57:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-18 23:57:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-18 23:57:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-18 23:57:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-18 23:57:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-18 23:57:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-18 23:57:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-18 23:57:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-18 23:57:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 23:57:47 [DEBUG   ] Finished updating board flags in 1.678 seconds
2013-06-18 23:57:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 23:58:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-18 23:58:31 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-18 23:58:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-18 23:58:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-18 23:58:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-18 23:58:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-18 23:58:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-18 23:58:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-18 23:58:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-18 23:58:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-18 23:58:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-18 23:58:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-18 23:58:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-18 23:58:47 [DEBUG   ] Finished updating board flags in 1.616 seconds
2013-06-18 23:58:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-18 23:59:11 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-18 23:59:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-18 23:59:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-18 23:59:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-18 23:59:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-18 23:59:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-18 23:59:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-18 23:59:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-18 23:59:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-18 23:59:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-18 23:59:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-18 23:59:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-18 23:59:47 [DEBUG   ] Finished updating board flags in 1.500 seconds
2013-06-18 23:59:51 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-19 00:00:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 00:00:32 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-19 00:00:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:00:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:00:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:00:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:00:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:00:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:00:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:00:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:00:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:00:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:00:48 [DEBUG   ] Finished updating board flags in 2.420 seconds
2013-06-19 00:00:52 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-19 00:01:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-19 00:01:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 00:01:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:01:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:01:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:01:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:01:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:01:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-19 00:01:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:01:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:01:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:01:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:01:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:01:47 [DEBUG   ] Finished updating board flags in 1.388 seconds
2013-06-19 00:01:52 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2013-06-19 00:02:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 00:02:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 00:02:40 [DEBUG   ] Got command RPT from MCS: ref #10208
2013-06-19 00:02:40 [DEBUG   ] summary = ERROR
2013-06-19 00:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10208  13 56462   160621 A  ERRORERROR'
2013-06-19 00:02:40 [DEBUG   ] Got command RPT from MCS: ref #10209
2013-06-19 00:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 00:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10209  77 56462   160622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 00:02:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:02:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:02:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:02:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:02:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:02:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:02:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:02:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:02:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:02:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:02:48 [DEBUG   ] Finished updating board flags in 2.207 seconds
2013-06-19 00:02:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 00:03:12 [DEBUG   ] Finished updating ant stats in 0.986 seconds
2013-06-19 00:03:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 00:03:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:03:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:03:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:03:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:03:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:03:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:03:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:03:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:03:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:03:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:03:48 [DEBUG   ] Finished updating board flags in 2.207 seconds
2013-06-19 00:03:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 00:04:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 00:04:32 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2013-06-19 00:04:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:04:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:04:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:04:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:04:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:04:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:04:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:04:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:04:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:04:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:04:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 00:04:48 [DEBUG   ] Finished updating board flags in 2.253 seconds
2013-06-19 00:04:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 00:05:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 00:05:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 00:05:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:05:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:05:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:05:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:05:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:05:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:05:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:05:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:05:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:05:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:05:48 [DEBUG   ] Finished updating board flags in 2.208 seconds
2013-06-19 00:05:52 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2013-06-19 00:06:13 [DEBUG   ] Finished updating ant stats in 1.390 seconds
2013-06-19 00:06:33 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 00:06:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:06:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:06:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:06:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:06:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:06:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:06:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:06:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:06:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:06:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:06:48 [DEBUG   ] Finished updating board flags in 2.143 seconds
2013-06-19 00:06:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 00:07:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 00:07:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 00:07:40 [DEBUG   ] Got command RPT from MCS: ref #10225
2013-06-19 00:07:40 [DEBUG   ] summary = ERROR
2013-06-19 00:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10225  13 56462   460617 A  ERRORERROR'
2013-06-19 00:07:40 [DEBUG   ] Got command RPT from MCS: ref #10226
2013-06-19 00:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 00:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10226  77 56462   460618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 00:07:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:07:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:07:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:07:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:07:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:07:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:07:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:07:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:07:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:07:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:07:48 [DEBUG   ] Finished updating board flags in 2.016 seconds
2013-06-19 00:07:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 00:08:13 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 00:08:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 00:08:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:08:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:08:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:08:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:08:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:08:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:08:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:08:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:08:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:08:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:08:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 00:08:48 [DEBUG   ] Finished updating board flags in 1.978 seconds
2013-06-19 00:08:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 00:09:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 00:09:33 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2013-06-19 00:09:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:09:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:09:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:09:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:09:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:09:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:09:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:09:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:09:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:09:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:09:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 00:09:48 [DEBUG   ] Finished updating board flags in 1.828 seconds
2013-06-19 00:09:54 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-19 00:10:14 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 00:10:34 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2013-06-19 00:10:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:10:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:10:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:10:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:10:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:10:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:10:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:10:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:10:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:10:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:10:48 [DEBUG   ] Finished updating board flags in 1.771 seconds
2013-06-19 00:10:54 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-19 00:11:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 00:11:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 00:11:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:11:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:11:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:11:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:11:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:11:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:11:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:11:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:11:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:11:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:11:48 [DEBUG   ] Finished updating board flags in 1.624 seconds
2013-06-19 00:11:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 00:12:14 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2013-06-19 00:12:34 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 00:12:40 [DEBUG   ] Got command RPT from MCS: ref #10242
2013-06-19 00:12:40 [DEBUG   ] summary = ERROR
2013-06-19 00:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10242  13 56462   760621 A  ERRORERROR'
2013-06-19 00:12:40 [DEBUG   ] Got command RPT from MCS: ref #10243
2013-06-19 00:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 00:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10243  77 56462   760622 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 00:12:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:12:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:12:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:12:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:12:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:12:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:12:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:12:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:12:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:12:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:12:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 00:12:48 [DEBUG   ] Finished updating board flags in 1.581 seconds
2013-06-19 00:12:55 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-19 00:13:15 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-19 00:13:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 00:13:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:13:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:13:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:13:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:13:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:13:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:13:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:13:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:13:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:13:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:13:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 00:13:48 [DEBUG   ] Finished updating board flags in 1.418 seconds
2013-06-19 00:13:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 00:14:15 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-19 00:14:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 00:14:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:14:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:14:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:14:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:14:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:14:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:14:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:14:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:14:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:14:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:14:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-19 00:14:48 [DEBUG   ] Finished updating board flags in 1.385 seconds
2013-06-19 00:14:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 00:15:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 00:15:35 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-19 00:15:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:15:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:15:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:15:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:15:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:15:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:15:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:15:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:15:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:15:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:15:49 [DEBUG   ] Finished updating board flags in 2.217 seconds
2013-06-19 00:15:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 00:16:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 00:16:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 00:16:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:16:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:16:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:16:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:16:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:16:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:16:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:16:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:16:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:16:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:16:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 00:16:49 [DEBUG   ] Finished updating board flags in 2.193 seconds
2013-06-19 00:16:55 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-19 00:17:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-19 00:17:35 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 00:17:40 [DEBUG   ] Got command RPT from MCS: ref #10259
2013-06-19 00:17:40 [DEBUG   ] summary = ERROR
2013-06-19 00:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10259  13 56462  1060629 A  ERRORERROR'
2013-06-19 00:17:40 [DEBUG   ] Got command RPT from MCS: ref #10260
2013-06-19 00:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 00:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10260  77 56462  1060630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 00:17:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:17:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:17:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:17:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:17:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:17:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:17:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:17:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:17:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:17:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:17:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 00:17:49 [DEBUG   ] Finished updating board flags in 2.007 seconds
2013-06-19 00:17:56 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-19 00:18:16 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-19 00:18:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 00:18:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:18:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:18:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:18:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:18:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:18:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:18:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:18:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:18:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:18:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:18:49 [DEBUG   ] Finished updating board flags in 1.989 seconds
2013-06-19 00:18:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 00:19:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 00:19:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 00:19:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:19:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:19:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:19:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:19:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:19:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:19:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:19:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:19:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:19:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:19:49 [DEBUG   ] Finished updating board flags in 1.809 seconds
2013-06-19 00:19:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 00:20:16 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2013-06-19 00:20:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 00:20:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:20:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:20:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:20:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:20:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:20:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:20:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:20:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:20:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:20:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:20:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 00:20:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 00:20:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 00:20:49 [DEBUG   ] Finished updating board flags in 1.810 seconds
2013-06-19 00:20:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 00:21:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 00:21:36 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 00:21:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:21:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:21:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:21:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:21:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:21:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:21:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:21:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:21:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:21:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:21:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 00:21:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 00:21:49 [DEBUG   ] Finished updating board flags in 1.788 seconds
2013-06-19 00:21:56 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-19 00:22:17 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-19 00:22:36 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-19 00:22:40 [DEBUG   ] Got command RPT from MCS: ref #10276
2013-06-19 00:22:40 [DEBUG   ] summary = ERROR
2013-06-19 00:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10276  13 56462  1360625 A  ERRORERROR'
2013-06-19 00:22:40 [DEBUG   ] Got command RPT from MCS: ref #10277
2013-06-19 00:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 00:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10277  77 56462  1360626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 00:22:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:22:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:22:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:22:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:22:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:22:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:22:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:22:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:22:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:22:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:22:49 [DEBUG   ] Finished updating board flags in 1.616 seconds
2013-06-19 00:22:57 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-19 00:23:17 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 00:23:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 00:23:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:23:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:23:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:23:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:23:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:23:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:23:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:23:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:23:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:23:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:23:49 [DEBUG   ] Finished updating board flags in 1.594 seconds
2013-06-19 00:23:57 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 00:24:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 00:24:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 00:24:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:24:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:24:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:24:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:24:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:24:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:24:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:24:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:24:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:24:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:24:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 00:24:49 [DEBUG   ] Finished updating board flags in 1.409 seconds
2013-06-19 00:24:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 00:25:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 00:25:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 00:25:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:25:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:25:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:25:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:25:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:25:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:25:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:25:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:25:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:25:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:25:49 [DEBUG   ] Finished updating board flags in 1.386 seconds
2013-06-19 00:25:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 00:26:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 00:26:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 00:26:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:26:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:26:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:26:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:26:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:26:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:26:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:26:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:26:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:26:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:26:50 [DEBUG   ] Finished updating board flags in 2.244 seconds
2013-06-19 00:26:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 00:27:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 00:27:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 00:27:40 [DEBUG   ] Got command RPT from MCS: ref #10293
2013-06-19 00:27:40 [DEBUG   ] summary = ERROR
2013-06-19 00:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10293  13 56462  1660629 A  ERRORERROR'
2013-06-19 00:27:40 [DEBUG   ] Got command RPT from MCS: ref #10294
2013-06-19 00:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 00:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10294  77 56462  1660630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 00:27:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:27:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:27:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:27:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:27:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:27:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:27:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:27:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:27:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:27:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:27:50 [DEBUG   ] Finished updating board flags in 2.171 seconds
2013-06-19 00:27:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 00:28:18 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-19 00:28:38 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-19 00:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:28:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:28:50 [DEBUG   ] Finished updating board flags in 2.001 seconds
2013-06-19 00:28:58 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 00:29:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 00:29:38 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 00:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:29:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:29:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-19 00:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:29:50 [DEBUG   ] Finished updating board flags in 1.992 seconds
2013-06-19 00:29:58 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 00:30:18 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 00:30:38 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2013-06-19 00:30:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:30:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:30:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:30:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:30:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:30:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:30:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:30:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:30:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:30:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:30:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 00:30:50 [DEBUG   ] Finished updating board flags in 1.812 seconds
2013-06-19 00:30:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 00:31:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 00:31:38 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 00:31:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:31:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:31:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:31:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:31:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:31:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:31:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:31:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:31:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:31:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:31:50 [DEBUG   ] Finished updating board flags in 1.789 seconds
2013-06-19 00:31:59 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-19 00:32:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 00:32:39 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2013-06-19 00:32:40 [DEBUG   ] Got command RPT from MCS: ref #10310
2013-06-19 00:32:40 [DEBUG   ] summary = ERROR
2013-06-19 00:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10310  13 56462  1960629 A  ERRORERROR'
2013-06-19 00:32:40 [DEBUG   ] Got command RPT from MCS: ref #10311
2013-06-19 00:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 00:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10311  77 56462  1960630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 00:32:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:32:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:32:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:32:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:32:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:32:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:32:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:32:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:32:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:32:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:32:50 [DEBUG   ] Finished updating board flags in 1.614 seconds
2013-06-19 00:32:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 00:33:19 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 00:33:39 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 00:33:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:33:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:33:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:33:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:33:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:33:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:33:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:33:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:33:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:33:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:33:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 00:33:50 [DEBUG   ] Finished updating board flags in 1.592 seconds
2013-06-19 00:33:59 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-19 00:34:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 00:34:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 00:34:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:34:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:34:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:34:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:34:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:34:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:34:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:34:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:34:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:34:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:34:50 [DEBUG   ] Finished updating board flags in 1.416 seconds
2013-06-19 00:34:59 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 00:35:19 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2013-06-19 00:35:40 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-19 00:35:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:35:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:35:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:35:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:35:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:35:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-19 00:35:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:35:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:35:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:35:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:35:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:35:50 [DEBUG   ] Finished updating board flags in 1.397 seconds
2013-06-19 00:36:00 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 00:36:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 00:36:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-19 00:36:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:36:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:36:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:36:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:36:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:36:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:36:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:36:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:36:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:36:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:36:51 [DEBUG   ] Finished updating board flags in 2.209 seconds
2013-06-19 00:37:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 00:37:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 00:37:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 00:37:40 [DEBUG   ] Got command RPT from MCS: ref #10327
2013-06-19 00:37:40 [DEBUG   ] summary = ERROR
2013-06-19 00:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10327  13 56462  2260625 A  ERRORERROR'
2013-06-19 00:37:40 [DEBUG   ] Got command RPT from MCS: ref #10328
2013-06-19 00:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 00:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10328  77 56462  2260626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 00:37:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:37:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:37:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:37:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:37:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:37:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:37:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:37:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:37:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:37:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:37:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 00:37:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 00:37:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-19 00:37:51 [DEBUG   ] Finished updating board flags in 2.191 seconds
2013-06-19 00:38:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 00:38:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 00:38:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 00:38:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:38:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:38:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:38:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:38:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:38:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:38:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:38:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:38:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:38:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:38:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 00:38:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 00:38:51 [DEBUG   ] Finished updating board flags in 2.014 seconds
2013-06-19 00:39:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 00:39:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 00:39:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 00:39:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:39:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:39:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:39:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:39:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:39:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:39:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:39:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:39:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:39:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:39:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 00:39:51 [DEBUG   ] Finished updating board flags in 1.980 seconds
2013-06-19 00:40:00 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2013-06-19 00:40:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 00:40:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 00:40:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 00:40:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 00:40:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 00:40:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 00:40:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 00:40:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 00:40:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 00:40:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 00:40:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 00:40:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 00:40:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-19 00:40:51 [DEBUG   ] Finished updating board flags in 1.818 seconds
2013-06-19 00:41:00 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-19 00:41:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 00:41:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997549
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997549
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997549
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997549
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997549
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-19 00:41:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997549
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997549
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997549
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997549
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997549
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-19 00:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-19 00:41:51 [DEBUG   ] Finished updating board flags in 1.813 seconds
2013-06-19 00:42:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-19 00:42:21 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-19 00:42:40 [DEBUG   ] Got command RPT from MCS: ref #10344
2013-06-19 00:42:40 [DEBUG   ] summary = ERROR
2013-06-19 00:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10344  13 56462  2560629 A  ERRORERROR'
2013-06-19 00:42:40 [DEBUG   ] Got command RPT from MCS: ref #10345
2013-06-19 00:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 00:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10345  77 56462  2560630 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 00:42:41 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997549
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997549
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997549
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997549
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997549
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-19 00:42:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997549
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997549
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997549
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997549
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997549
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-19 00:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-19 00:42:51 [DEBUG   ] Finished updating board flags in 1.812 seconds
2013-06-19 00:43:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-19 00:43:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 00:43:41 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2013-06-19 00:43:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997549
2013-06-19 00:43:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997549
2013-06-19 00:43:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997549
2013-06-19 00:43:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997549
2013-06-19 00:43:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997549
2013-06-19 00:43:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997549
2013-06-19 00:43:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997549
2013-06-19 00:43:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997549
2013-06-19 00:43:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997549
2013-06-19 00:43:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997549
2013-06-19 00:43:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 00:43:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-19 00:43:51 [DEBUG   ] Finished updating board flags in 1.772 seconds
2013-06-19 00:44:01 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-19 00:44:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 00:44:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 00:44:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997549
2013-06-19 00:44:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997549
2013-06-19 00:44:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997549
2013-06-19 00:44:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997549
2013-06-19 00:44:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997549
2013-06-19 00:44:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997549
2013-06-19 00:44:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997549
2013-06-19 00:44:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997549
2013-06-19 00:44:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997549
2013-06-19 00:44:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997549
2013-06-19 00:44:51 [DEBUG   ] Finished updating board flags in 1.615 seconds
2013-06-19 00:45:01 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 00:45:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 00:45:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 00:45:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997549
2013-06-19 00:45:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997549
2013-06-19 00:45:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997549
2013-06-19 00:45:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997549
2013-06-19 00:45:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997549
2013-06-19 00:45:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997549
2013-06-19 00:45:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997549
2013-06-19 00:45:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997549
2013-06-19 00:45:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997549
2013-06-19 00:45:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997549
2013-06-19 00:45:51 [DEBUG   ] Finished updating board flags in 1.583 seconds
2013-06-19 00:46:01 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 00:46:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 00:46:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-19 00:46:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997549
2013-06-19 00:46:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997549
2013-06-19 00:46:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997549
2013-06-19 00:46:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997549
2013-06-19 00:46:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997549
2013-06-19 00:46:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997549
2013-06-19 00:46:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997549
2013-06-19 00:46:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997549
2013-06-19 00:46:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997549
2013-06-19 00:46:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997549
2013-06-19 00:46:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 00:46:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 00:46:51 [DEBUG   ] Finished updating board flags in 1.421 seconds
2013-06-19 00:47:01 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 00:47:22 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-19 00:47:40 [DEBUG   ] Got command RPT from MCS: ref #10361
2013-06-19 00:47:40 [DEBUG   ] summary = ERROR
2013-06-19 00:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10361  13 56462  2860633 A  ERRORERROR'
2013-06-19 00:47:40 [DEBUG   ] Got command RPT from MCS: ref #10362
2013-06-19 00:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 00:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10362  77 56462  2860634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 00:47:42 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-19 00:47:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997549
2013-06-19 00:47:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997549
2013-06-19 00:47:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997549
2013-06-19 00:47:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997549
2013-06-19 00:47:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997549
2013-06-19 00:47:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997549
2013-06-19 00:47:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997549
2013-06-19 00:47:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997549
2013-06-19 00:47:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997549
2013-06-19 00:47:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997549
2013-06-19 00:47:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 00:47:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 00:47:51 [DEBUG   ] Finished updating board flags in 1.387 seconds
2013-06-19 00:48:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 00:48:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 00:48:42 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-19 00:48:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-19 00:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-19 00:48:52 [DEBUG   ] Finished updating board flags in 2.224 seconds
2013-06-19 00:49:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 00:49:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 00:49:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-19 00:49:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-19 00:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-19 00:49:52 [DEBUG   ] Finished updating board flags in 2.216 seconds
2013-06-19 00:50:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 00:50:22 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-19 00:50:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 00:50:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 00:50:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 00:50:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 00:50:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 00:50:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 00:50:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 00:50:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 00:50:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 00:50:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 00:50:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 00:50:52 [DEBUG   ] Finished updating board flags in 2.167 seconds
2013-06-19 00:51:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 00:51:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 00:51:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-19 00:51:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 00:51:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 00:51:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 00:51:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 00:51:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 00:51:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 00:51:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 00:51:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 00:51:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 00:51:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 00:51:52 [DEBUG   ] Finished updating board flags in 2.015 seconds
2013-06-19 00:52:02 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 00:52:23 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-19 00:52:40 [DEBUG   ] Got command RPT from MCS: ref #10378
2013-06-19 00:52:40 [DEBUG   ] summary = ERROR
2013-06-19 00:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10378  13 56462  3160633 A  ERRORERROR'
2013-06-19 00:52:40 [DEBUG   ] Got command RPT from MCS: ref #10379
2013-06-19 00:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 00:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10379  77 56462  3160634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 00:52:43 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-19 00:52:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 00:52:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 00:52:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 00:52:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 00:52:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 00:52:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 00:52:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 00:52:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 00:52:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 00:52:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 00:52:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 00:52:52 [DEBUG   ] Finished updating board flags in 1.993 seconds
2013-06-19 00:53:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 00:53:23 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 00:53:43 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2013-06-19 00:53:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 00:53:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 00:53:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 00:53:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 00:53:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 00:53:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 00:53:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 00:53:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 00:53:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 00:53:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 00:53:52 [DEBUG   ] Finished updating board flags in 1.803 seconds
2013-06-19 00:54:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 00:54:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 00:54:43 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 00:54:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 00:54:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 00:54:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 00:54:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 00:54:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 00:54:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 00:54:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 00:54:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 00:54:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 00:54:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 00:54:52 [DEBUG   ] Finished updating board flags in 1.814 seconds
2013-06-19 00:55:03 [DEBUG   ] Finished updating ant stats in 0.786 seconds
2013-06-19 00:55:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 00:55:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 00:55:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 00:55:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 00:55:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 00:55:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 00:55:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 00:55:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 00:55:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 00:55:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 00:55:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 00:55:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 00:55:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 00:55:52 [DEBUG   ] Finished updating board flags in 1.790 seconds
2013-06-19 00:56:03 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 00:56:24 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-19 00:56:44 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-19 00:56:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 00:56:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 00:56:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 00:56:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 00:56:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 00:56:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 00:56:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 00:56:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 00:56:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 00:56:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 00:56:52 [DEBUG   ] Finished updating board flags in 1.620 seconds
2013-06-19 00:57:04 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 00:57:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 00:57:40 [DEBUG   ] Got command RPT from MCS: ref #10395
2013-06-19 00:57:40 [DEBUG   ] summary = ERROR
2013-06-19 00:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10395  13 56462  3460637 A  ERRORERROR'
2013-06-19 00:57:40 [DEBUG   ] Got command RPT from MCS: ref #10396
2013-06-19 00:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 00:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10396  77 56462  3460638 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 00:57:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 00:57:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 00:57:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 00:57:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 00:57:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 00:57:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 00:57:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 00:57:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 00:57:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 00:57:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 00:57:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 00:57:52 [DEBUG   ] Finished updating board flags in 1.587 seconds
2013-06-19 00:58:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 00:58:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 00:58:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 00:58:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 00:58:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 00:58:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 00:58:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 00:58:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 00:58:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 00:58:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 00:58:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 00:58:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 00:58:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 00:58:52 [DEBUG   ] Finished updating board flags in 1.407 seconds
2013-06-19 00:59:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 00:59:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 00:59:44 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 00:59:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 00:59:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 00:59:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 00:59:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 00:59:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 00:59:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 00:59:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 00:59:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 00:59:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 00:59:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 00:59:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 00:59:52 [DEBUG   ] Finished updating board flags in 1.444 seconds
2013-06-19 01:00:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 01:00:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 01:00:44 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-19 01:00:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 01:00:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 01:00:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 01:00:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 01:00:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 01:00:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 01:00:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 01:00:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 01:00:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 01:00:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 01:00:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-06-19 01:00:52 [DEBUG   ] Finished updating board flags in 1.426 seconds
2013-06-19 01:01:04 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2013-06-19 01:01:24 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-19 01:01:45 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-19 01:01:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 01:01:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 01:01:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 01:01:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 01:01:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 01:01:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 01:01:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 01:01:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 01:01:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 01:01:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 01:01:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 01:01:53 [DEBUG   ] Finished updating board flags in 2.376 seconds
2013-06-19 01:02:05 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-19 01:02:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-19 01:02:40 [DEBUG   ] Got command RPT from MCS: ref #10412
2013-06-19 01:02:40 [DEBUG   ] summary = ERROR
2013-06-19 01:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10412  13 56462  3760634 A  ERRORERROR'
2013-06-19 01:02:40 [DEBUG   ] Got command RPT from MCS: ref #10413
2013-06-19 01:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 01:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10413  77 56462  3760634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 01:02:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-19 01:02:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 01:02:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 01:02:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 01:02:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 01:02:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 01:02:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 01:02:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 01:02:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 01:02:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 01:02:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 01:02:53 [DEBUG   ] Finished updating board flags in 2.152 seconds
2013-06-19 01:03:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 01:03:25 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 01:03:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 01:03:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 01:03:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 01:03:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 01:03:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 01:03:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 01:03:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 01:03:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 01:03:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 01:03:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 01:03:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 01:03:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 01:03:53 [DEBUG   ] Finished updating board flags in 2.020 seconds
2013-06-19 01:04:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 01:04:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 01:04:45 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 01:04:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 01:04:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 01:04:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 01:04:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 01:04:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 01:04:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 01:04:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 01:04:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 01:04:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 01:04:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 01:04:53 [DEBUG   ] Finished updating board flags in 2.001 seconds
2013-06-19 01:05:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 01:05:25 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-19 01:05:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 01:05:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 01:05:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 01:05:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 01:05:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 01:05:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 01:05:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 01:05:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 01:05:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 01:05:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 01:05:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 01:05:53 [DEBUG   ] Finished updating board flags in 2.014 seconds
2013-06-19 01:06:05 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 01:06:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 01:06:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 01:06:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 01:06:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 01:06:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 01:06:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 01:06:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 01:06:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 01:06:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 01:06:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 01:06:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 01:06:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 01:06:53 [DEBUG   ] Finished updating board flags in 1.976 seconds
2013-06-19 01:07:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 01:07:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 01:07:40 [DEBUG   ] Got command RPT from MCS: ref #10429
2013-06-19 01:07:40 [DEBUG   ] summary = ERROR
2013-06-19 01:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10429  13 56462  4060633 A  ERRORERROR'
2013-06-19 01:07:40 [DEBUG   ] Got command RPT from MCS: ref #10430
2013-06-19 01:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 01:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10430  77 56462  4060634 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 01:07:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 01:07:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 01:07:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 01:07:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 01:07:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 01:07:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 01:07:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 01:07:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 01:07:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 01:07:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 01:07:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 01:07:53 [DEBUG   ] Finished updating board flags in 1.821 seconds
2013-06-19 01:08:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-19 01:08:26 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-19 01:08:46 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-19 01:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 01:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 01:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 01:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 01:08:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 01:08:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 01:08:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 01:08:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 01:08:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 01:08:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 01:08:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 01:08:53 [DEBUG   ] Finished updating board flags in 1.790 seconds
2013-06-19 01:09:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 01:09:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 01:09:46 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 01:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 01:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 01:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 01:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 01:09:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 01:09:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 01:09:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 01:09:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 01:09:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 01:09:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 01:09:53 [DEBUG   ] Finished updating board flags in 1.611 seconds
2013-06-19 01:10:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 01:10:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 01:10:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 01:10:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 01:10:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 01:10:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 01:10:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 01:10:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 01:10:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 01:10:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 01:10:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 01:10:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 01:10:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 01:10:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 01:10:53 [DEBUG   ] Finished updating board flags in 1.591 seconds
2013-06-19 01:11:06 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 01:11:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 01:11:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 01:11:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 01:11:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 01:11:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 01:11:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 01:11:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 01:11:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 01:11:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 01:11:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 01:11:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 01:11:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 01:11:53 [DEBUG   ] Finished updating board flags in 1.418 seconds
2013-06-19 01:12:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 01:12:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 01:12:40 [DEBUG   ] Got command RPT from MCS: ref #10446
2013-06-19 01:12:40 [DEBUG   ] summary = ERROR
2013-06-19 01:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10446  13 56462  4360641 A  ERRORERROR'
2013-06-19 01:12:40 [DEBUG   ] Got command RPT from MCS: ref #10447
2013-06-19 01:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 01:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10447  77 56462  4360642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 01:12:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 01:12:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 01:12:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 01:12:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 01:12:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 01:12:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 01:12:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 01:12:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 01:12:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 01:12:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 01:12:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 01:12:53 [DEBUG   ] Finished updating board flags in 1.380 seconds
2013-06-19 01:13:06 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 01:13:26 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 01:13:47 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-19 01:13:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 01:13:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 01:13:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 01:13:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 01:13:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 01:13:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 01:13:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 01:13:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 01:13:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 01:13:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 01:13:54 [DEBUG   ] Finished updating board flags in 2.218 seconds
2013-06-19 01:14:07 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-19 01:14:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 01:14:47 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-19 01:14:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 01:14:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 01:14:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 01:14:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 01:14:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 01:14:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 01:14:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 01:14:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 01:14:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 01:14:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 01:14:54 [DEBUG   ] Finished updating board flags in 2.195 seconds
2013-06-19 01:15:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 01:15:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 01:15:47 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 01:15:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 01:15:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 01:15:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 01:15:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 01:15:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 01:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 01:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 01:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 01:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 01:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 01:15:54 [DEBUG   ] Finished updating board flags in 2.010 seconds
2013-06-19 01:16:07 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-19 01:16:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 01:16:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 01:16:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997451
2013-06-19 01:16:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997451
2013-06-19 01:16:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997451
2013-06-19 01:16:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997451
2013-06-19 01:16:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997451
2013-06-19 01:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997451
2013-06-19 01:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997451
2013-06-19 01:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997451
2013-06-19 01:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997451
2013-06-19 01:16:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997451
2013-06-19 01:16:54 [DEBUG   ] Finished updating board flags in 2.003 seconds
2013-06-19 01:17:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 01:17:27 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-19 01:17:40 [DEBUG   ] Got command RPT from MCS: ref #10463
2013-06-19 01:17:40 [DEBUG   ] summary = ERROR
2013-06-19 01:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10463  13 56462  4660641 A  ERRORERROR'
2013-06-19 01:17:40 [DEBUG   ] Got command RPT from MCS: ref #10464
2013-06-19 01:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 01:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10464  77 56462  4660642 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 01:17:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997255
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997255
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997255
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997255
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997255
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-19 01:17:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997255
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997255
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997255
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997255
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997255
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-19 01:17:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-19 01:17:54 [DEBUG   ] Finished updating board flags in 2.017 seconds
2013-06-19 01:18:07 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-19 01:18:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 01:18:47 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997255
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997255
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997255
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997255
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997255
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-19 01:18:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997255
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997255
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997255
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997255
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997255
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-19 01:18:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-19 01:18:54 [DEBUG   ] Finished updating board flags in 1.987 seconds
2013-06-19 01:19:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 01:19:27 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 01:19:48 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-19 01:19:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997255
2013-06-19 01:19:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997255
2013-06-19 01:19:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997255
2013-06-19 01:19:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997255
2013-06-19 01:19:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997255
2013-06-19 01:19:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997255
2013-06-19 01:19:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997255
2013-06-19 01:19:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997255
2013-06-19 01:19:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997255
2013-06-19 01:19:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997255
2013-06-19 01:19:54 [DEBUG   ] Finished updating board flags in 1.807 seconds
2013-06-19 01:20:08 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-19 01:20:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 01:20:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 01:20:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997255
2013-06-19 01:20:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997255
2013-06-19 01:20:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997255
2013-06-19 01:20:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997255
2013-06-19 01:20:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997255
2013-06-19 01:20:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997255
2013-06-19 01:20:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997255
2013-06-19 01:20:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997255
2013-06-19 01:20:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997255
2013-06-19 01:20:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997255
2013-06-19 01:20:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 01:20:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 01:20:54 [DEBUG   ] Finished updating board flags in 1.786 seconds
2013-06-19 01:21:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 01:21:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 01:21:48 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 01:21:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997255
2013-06-19 01:21:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997255
2013-06-19 01:21:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997255
2013-06-19 01:21:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997255
2013-06-19 01:21:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997255
2013-06-19 01:21:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997255
2013-06-19 01:21:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997255
2013-06-19 01:21:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997255
2013-06-19 01:21:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997255
2013-06-19 01:21:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997255
2013-06-19 01:21:54 [DEBUG   ] Finished updating board flags in 1.612 seconds
2013-06-19 01:22:08 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2013-06-19 01:22:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 01:22:40 [DEBUG   ] Got command RPT from MCS: ref #10480
2013-06-19 01:22:40 [DEBUG   ] summary = ERROR
2013-06-19 01:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10480  13 56462  4960637 A  ERRORERROR'
2013-06-19 01:22:40 [DEBUG   ] Got command RPT from MCS: ref #10481
2013-06-19 01:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 01:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10481  77 56462  4960638 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 01:22:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 01:22:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997255
2013-06-19 01:22:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997255
2013-06-19 01:22:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997255
2013-06-19 01:22:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997255
2013-06-19 01:22:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997255
2013-06-19 01:22:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997255
2013-06-19 01:22:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997255
2013-06-19 01:22:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997255
2013-06-19 01:22:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997255
2013-06-19 01:22:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997255
2013-06-19 01:22:54 [DEBUG   ] Finished updating board flags in 1.592 seconds
2013-06-19 01:23:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 01:23:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 01:23:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 01:23:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997255
2013-06-19 01:23:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997255
2013-06-19 01:23:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997255
2013-06-19 01:23:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997255
2013-06-19 01:23:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997255
2013-06-19 01:23:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997255
2013-06-19 01:23:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997255
2013-06-19 01:23:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997255
2013-06-19 01:23:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997255
2013-06-19 01:23:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997255
2013-06-19 01:23:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 01:23:54 [DEBUG   ] Finished updating board flags in 1.409 seconds
2013-06-19 01:24:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 01:24:28 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-19 01:24:48 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 01:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997255
2013-06-19 01:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997255
2013-06-19 01:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997255
2013-06-19 01:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997255
2013-06-19 01:24:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997255
2013-06-19 01:24:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997255
2013-06-19 01:24:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997255
2013-06-19 01:24:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997255
2013-06-19 01:24:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997255
2013-06-19 01:24:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997255
2013-06-19 01:24:54 [DEBUG   ] Finished updating board flags in 1.454 seconds
2013-06-19 01:25:09 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-19 01:25:29 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 01:25:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 01:25:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997255
2013-06-19 01:25:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997255
2013-06-19 01:25:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997255
2013-06-19 01:25:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997255
2013-06-19 01:25:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997255
2013-06-19 01:25:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997255
2013-06-19 01:25:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997255
2013-06-19 01:25:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997255
2013-06-19 01:25:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997255
2013-06-19 01:25:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997255
2013-06-19 01:25:54 [DEBUG   ] Finished updating board flags in 1.423 seconds
2013-06-19 01:26:09 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-19 01:26:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 01:26:49 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-19 01:26:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997255
2013-06-19 01:26:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997255
2013-06-19 01:26:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997255
2013-06-19 01:26:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997255
2013-06-19 01:26:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997255
2013-06-19 01:26:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997255
2013-06-19 01:26:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997255
2013-06-19 01:26:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997255
2013-06-19 01:26:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997255
2013-06-19 01:26:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997255
2013-06-19 01:26:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 01:26:55 [DEBUG   ] Finished updating board flags in 2.377 seconds
2013-06-19 01:27:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 01:27:29 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-19 01:27:40 [DEBUG   ] Got command RPT from MCS: ref #10497
2013-06-19 01:27:40 [DEBUG   ] summary = ERROR
2013-06-19 01:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10497  13 56462  5260645 A  ERRORERROR'
2013-06-19 01:27:40 [DEBUG   ] Got command RPT from MCS: ref #10498
2013-06-19 01:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 01:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10498  77 56462  5260646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 01:27:50 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-19 01:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997255
2013-06-19 01:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997255
2013-06-19 01:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997255
2013-06-19 01:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997255
2013-06-19 01:27:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997255
2013-06-19 01:27:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997255
2013-06-19 01:27:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997255
2013-06-19 01:27:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997255
2013-06-19 01:27:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997255
2013-06-19 01:27:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997255
2013-06-19 01:27:55 [DEBUG   ] Finished updating board flags in 2.145 seconds
2013-06-19 01:28:10 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 01:28:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-19 01:28:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 01:28:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997255
2013-06-19 01:28:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997255
2013-06-19 01:28:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997255
2013-06-19 01:28:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997255
2013-06-19 01:28:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997255
2013-06-19 01:28:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997255
2013-06-19 01:28:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997255
2013-06-19 01:28:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997255
2013-06-19 01:28:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997255
2013-06-19 01:28:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997255
2013-06-19 01:28:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 01:28:55 [DEBUG   ] Finished updating board flags in 2.021 seconds
2013-06-19 01:29:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 01:29:30 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 01:29:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 01:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997255
2013-06-19 01:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997255
2013-06-19 01:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997255
2013-06-19 01:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997255
2013-06-19 01:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997255
2013-06-19 01:29:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997255
2013-06-19 01:29:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997255
2013-06-19 01:29:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997255
2013-06-19 01:29:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997255
2013-06-19 01:29:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997255
2013-06-19 01:29:55 [DEBUG   ] Finished updating board flags in 1.984 seconds
2013-06-19 01:30:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 01:30:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 01:30:50 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 01:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997255
2013-06-19 01:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997255
2013-06-19 01:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997255
2013-06-19 01:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997255
2013-06-19 01:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997255
2013-06-19 01:30:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997255
2013-06-19 01:30:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997255
2013-06-19 01:30:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997255
2013-06-19 01:30:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997255
2013-06-19 01:30:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997255
2013-06-19 01:30:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 01:30:55 [DEBUG   ] Finished updating board flags in 1.823 seconds
2013-06-19 01:31:10 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 01:31:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 01:31:51 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-19 01:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997255
2013-06-19 01:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997255
2013-06-19 01:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997255
2013-06-19 01:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997255
2013-06-19 01:31:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997255
2013-06-19 01:31:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-19 01:31:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997255
2013-06-19 01:31:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997255
2013-06-19 01:31:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997255
2013-06-19 01:31:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997255
2013-06-19 01:31:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997255
2013-06-19 01:31:55 [DEBUG   ] Finished updating board flags in 1.781 seconds
2013-06-19 01:32:11 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-19 01:32:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 01:32:40 [DEBUG   ] Got command RPT from MCS: ref #10514
2013-06-19 01:32:40 [DEBUG   ] summary = ERROR
2013-06-19 01:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10514  13 56462  5560645 A  ERRORERROR'
2013-06-19 01:32:40 [DEBUG   ] Got command RPT from MCS: ref #10515
2013-06-19 01:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 01:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10515  77 56462  5560646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 01:32:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 01:32:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997255
2013-06-19 01:32:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997255
2013-06-19 01:32:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997255
2013-06-19 01:32:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997255
2013-06-19 01:32:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997255
2013-06-19 01:32:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997255
2013-06-19 01:32:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997255
2013-06-19 01:32:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997255
2013-06-19 01:32:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997255
2013-06-19 01:32:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997255
2013-06-19 01:32:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 01:32:55 [DEBUG   ] Finished updating board flags in 1.610 seconds
2013-06-19 01:33:11 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-19 01:33:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 01:33:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 01:33:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997255
2013-06-19 01:33:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997255
2013-06-19 01:33:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997255
2013-06-19 01:33:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997255
2013-06-19 01:33:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997255
2013-06-19 01:33:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997255
2013-06-19 01:33:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997255
2013-06-19 01:33:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997255
2013-06-19 01:33:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997255
2013-06-19 01:33:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997255
2013-06-19 01:33:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 01:33:55 [DEBUG   ] Finished updating board flags in 1.593 seconds
2013-06-19 01:34:11 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2013-06-19 01:34:31 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-19 01:34:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 01:34:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997255
2013-06-19 01:34:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997255
2013-06-19 01:34:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997255
2013-06-19 01:34:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997255
2013-06-19 01:34:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997255
2013-06-19 01:34:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997255
2013-06-19 01:34:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997255
2013-06-19 01:34:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997255
2013-06-19 01:34:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997255
2013-06-19 01:34:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997255
2013-06-19 01:34:55 [DEBUG   ] Finished updating board flags in 1.415 seconds
2013-06-19 01:35:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 01:35:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 01:35:51 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2013-06-19 01:35:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997255
2013-06-19 01:35:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997255
2013-06-19 01:35:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997255
2013-06-19 01:35:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997255
2013-06-19 01:35:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997255
2013-06-19 01:35:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-19 01:35:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997255
2013-06-19 01:35:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997255
2013-06-19 01:35:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997255
2013-06-19 01:35:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997255
2013-06-19 01:35:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997255
2013-06-19 01:35:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 01:35:55 [DEBUG   ] Finished updating board flags in 1.389 seconds
2013-06-19 01:36:12 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-06-19 01:36:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 01:36:51 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 01:36:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997255
2013-06-19 01:36:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997255
2013-06-19 01:36:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997255
2013-06-19 01:36:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997255
2013-06-19 01:36:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997255
2013-06-19 01:36:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997255
2013-06-19 01:36:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997255
2013-06-19 01:36:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997255
2013-06-19 01:36:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997255
2013-06-19 01:36:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997255
2013-06-19 01:36:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 01:36:56 [DEBUG   ] Finished updating board flags in 2.214 seconds
2013-06-19 01:37:12 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-19 01:37:32 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-19 01:37:40 [DEBUG   ] Got command RPT from MCS: ref #10531
2013-06-19 01:37:40 [DEBUG   ] summary = ERROR
2013-06-19 01:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10531  13 56462  5860645 A  ERRORERROR'
2013-06-19 01:37:40 [DEBUG   ] Got command RPT from MCS: ref #10532
2013-06-19 01:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 01:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10532  77 56462  5860646 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 01:37:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 01:37:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997255
2013-06-19 01:37:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997255
2013-06-19 01:37:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997255
2013-06-19 01:37:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997255
2013-06-19 01:37:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997255
2013-06-19 01:37:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997255
2013-06-19 01:37:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997255
2013-06-19 01:37:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997255
2013-06-19 01:37:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997255
2013-06-19 01:37:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997255
2013-06-19 01:37:56 [DEBUG   ] Finished updating board flags in 2.190 seconds
2013-06-19 01:38:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 01:38:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 01:38:52 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 01:38:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997255
2013-06-19 01:38:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997255
2013-06-19 01:38:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997255
2013-06-19 01:38:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997255
2013-06-19 01:38:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997255
2013-06-19 01:38:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997255
2013-06-19 01:38:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997255
2013-06-19 01:38:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997255
2013-06-19 01:38:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997255
2013-06-19 01:38:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997255
2013-06-19 01:38:56 [DEBUG   ] Finished updating board flags in 2.006 seconds
2013-06-19 01:39:12 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2013-06-19 01:39:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 01:39:52 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-19 01:39:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997255
2013-06-19 01:39:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997255
2013-06-19 01:39:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997255
2013-06-19 01:39:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997255
2013-06-19 01:39:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997255
2013-06-19 01:39:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997255
2013-06-19 01:39:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997255
2013-06-19 01:39:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997255
2013-06-19 01:39:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997255
2013-06-19 01:39:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997255
2013-06-19 01:39:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-06-19 01:39:56 [DEBUG   ] Finished updating board flags in 2.008 seconds
2013-06-19 01:40:00 [DEBUG   ] Got command INI from MCS: ref #10548
2013-06-19 01:40:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2013-06-19 01:40:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    10548   8 56462  6000898 ABOOTING'
2013-06-19 01:40:24 [INFO    ] -------------------
2013-06-19 01:40:24 [INFO    ]  LWA board status
2013-06-19 01:40:24 [INFO    ] -------------------
2013-06-19 01:40:24 [INFO    ] DP 1: 2 lwa27
2013-06-19 01:40:24 [INFO    ] DP 1: 3 lwa24
2013-06-19 01:40:24 [INFO    ] DP 1: 4 lwa23
2013-06-19 01:40:24 [INFO    ] DP 1: 5 lwa18
2013-06-19 01:40:24 [INFO    ] DP 1: 6 lwa10
2013-06-19 01:40:24 [INFO    ] DP 1: 7 lwa32
2013-06-19 01:40:24 [INFO    ] DP 1: 8 lwa11
2013-06-19 01:40:24 [INFO    ] DP 1: 9 lwa30
2013-06-19 01:40:24 [INFO    ] DP 1: 10 lwa12
2013-06-19 01:40:24 [INFO    ] DP 1: 11 lwa8
2013-06-19 01:40:24 [INFO    ] DP 1: 12 lwa13
2013-06-19 01:40:24 [INFO    ] DP 1: 13 lwa26
2013-06-19 01:40:24 [INFO    ] DP 1: 14 lwa14
2013-06-19 01:40:24 [INFO    ] DP 1: 16 lwa22
2013-06-19 01:40:24 [INFO    ] DP 1: 17 lwa20
2013-06-19 01:40:24 [INFO    ] DP 1: 18 lwa1
2013-06-19 01:40:24 [INFO    ] DP 1: 19 lwa5
2013-06-19 01:40:24 [INFO    ] DP 1: 20 lwa25
2013-06-19 01:40:24 [INFO    ] DP 1: 21 lwa35
2013-06-19 01:40:24 [INFO    ] DP 1: 22 lwa19
2013-06-19 01:40:24 [INFO    ] DP 1: 23 lwa21
2013-06-19 01:40:24 [INFO    ] DP 1: 24 lwa6
2013-06-19 01:40:24 [INFO    ] DP 1: 25 lwa7
2013-06-19 01:40:24 [INFO    ] DP 1: 26 lwa33
2013-06-19 01:40:24 [INFO    ] DP 1: 27 lwa15
2013-06-19 01:40:24 [INFO    ] DP 1: 28 lwa28
2013-06-19 01:40:24 [INFO    ] DP 2: 1 lwa16
2013-06-19 01:40:24 [INFO    ] DP 2: 15 lwa34
2013-06-19 01:40:24 [INFO    ] Total of 28 boards
2013-06-19 01:40:24 [INFO    ] Total of 260 stands
2013-06-19 01:40:24 [INFO    ] -------------------
2013-06-19 01:40:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23803
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23804
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23805
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23806
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23807
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23808
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23809
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23810
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23811
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23812
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23813
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23814
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23815
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23816
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23817
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23818
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23819
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23820
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23821
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23822
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23823
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23824
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23825
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23826
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23827
2013-06-19 01:40:32 [DEBUG   ] 2013-06-19 01:40:32 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23828
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23803 exited with status 0
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23804 exited with status 0
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23805 exited with status 0
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23806 exited with status 0
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23807 exited with status 0
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23808 exited with status 0
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23809 exited with status 0
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23810 exited with status 0
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23811 exited with status 0
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23812 exited with status 0
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23813 exited with status 0
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23814 exited with status 0
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23815 exited with status 0
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23816 exited with status 0
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23817 exited with status 0
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23818 exited with status 0
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23819 exited with status 0
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23820 exited with status 0
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23821 exited with status 0
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23822 exited with status 0
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23823 exited with status 0
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23824 exited with status 0
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23825 exited with status 0
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23826 exited with status 0
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23827 exited with status 0
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23828 exited with status 0
2013-06-19 01:40:44 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] spawn_process: at 2013-06-19 01:40:44 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 23855
2013-06-19 01:40:44 [DEBUG   ] 2013-06-19 01:40:44 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 23856
2013-06-19 01:40:50 [DEBUG   ] 2013-06-19 01:40:50 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 23855 exited with status 0
2013-06-19 01:40:50 [DEBUG   ] 2013-06-19 01:40:50 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 23856 exited with status 0
2013-06-19 01:40:50 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2013-06-19 01:40:50 [DEBUG   ] spawn_process: at 2013-06-19 01:40:50 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2013-06-19 01:40:50 [DEBUG   ] spawn_process: at 2013-06-19 01:40:50 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2013-06-19 01:40:50 [INFO    ] Setting Beam 1 xbars
2013-06-19 01:40:50 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2013-06-19 01:40:50 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2013-06-19 01:40:50 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2013-06-19 01:40:50 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2013-06-19 01:40:50 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2013-06-19 01:40:50 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2013-06-19 01:40:50 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2013-06-19 01:40:50 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2013-06-19 01:40:50 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2013-06-19 01:40:50 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2013-06-19 01:40:51 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2013-06-19 01:40:51 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2013-06-19 01:40:51 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2013-06-19 01:40:51 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2013-06-19 01:40:51 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2013-06-19 01:40:51 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2013-06-19 01:40:51 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2013-06-19 01:40:51 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2013-06-19 01:40:51 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2013-06-19 01:40:52 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2013-06-19 01:40:52 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2013-06-19 01:40:52 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2013-06-19 01:40:52 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2013-06-19 01:40:52 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2013-06-19 01:40:52 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2013-06-19 01:40:52 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2013-06-19 01:40:52 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2013-06-19 01:40:52 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2013-06-19 01:40:53 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2013-06-19 01:40:53 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2013-06-19 01:40:53 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2013-06-19 01:40:53 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2013-06-19 01:40:53 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2013-06-19 01:40:53 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2013-06-19 01:40:53 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2013-06-19 01:40:53 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2013-06-19 01:40:53 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2013-06-19 01:40:54 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2013-06-19 01:40:54 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2013-06-19 01:40:54 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2013-06-19 01:40:54 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2013-06-19 01:40:54 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2013-06-19 01:40:54 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2013-06-19 01:40:54 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2013-06-19 01:40:54 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2013-06-19 01:40:54 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2013-06-19 01:40:55 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2013-06-19 01:40:55 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2013-06-19 01:40:55 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2013-06-19 01:40:55 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2013-06-19 01:40:55 [INFO    ] Setting Beam 2 xbars
2013-06-19 01:40:55 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2013-06-19 01:40:55 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2013-06-19 01:40:55 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2013-06-19 01:40:55 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2013-06-19 01:40:55 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2013-06-19 01:40:55 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2013-06-19 01:40:56 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2013-06-19 01:40:56 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2013-06-19 01:40:56 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2013-06-19 01:40:56 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2013-06-19 01:40:56 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2013-06-19 01:40:56 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2013-06-19 01:40:56 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2013-06-19 01:40:56 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2013-06-19 01:40:56 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2013-06-19 01:40:57 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2013-06-19 01:40:57 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2013-06-19 01:40:57 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2013-06-19 01:40:57 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2013-06-19 01:40:57 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2013-06-19 01:40:57 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2013-06-19 01:40:57 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2013-06-19 01:40:57 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2013-06-19 01:40:57 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2013-06-19 01:40:58 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2013-06-19 01:40:58 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2013-06-19 01:40:58 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2013-06-19 01:40:58 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2013-06-19 01:40:58 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2013-06-19 01:40:58 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2013-06-19 01:40:58 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2013-06-19 01:40:58 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2013-06-19 01:40:58 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2013-06-19 01:40:59 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2013-06-19 01:40:59 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2013-06-19 01:40:59 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2013-06-19 01:40:59 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2013-06-19 01:40:59 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2013-06-19 01:40:59 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2013-06-19 01:40:59 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2013-06-19 01:40:59 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2013-06-19 01:40:59 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2013-06-19 01:41:00 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2013-06-19 01:41:00 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2013-06-19 01:41:00 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2013-06-19 01:41:00 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2013-06-19 01:41:00 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2013-06-19 01:41:00 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2013-06-19 01:41:00 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2013-06-19 01:41:00 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2013-06-19 01:41:00 [INFO    ] Setting Beam 3 xbars
2013-06-19 01:41:00 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2013-06-19 01:41:01 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2013-06-19 01:41:01 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2013-06-19 01:41:01 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2013-06-19 01:41:01 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2013-06-19 01:41:01 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2013-06-19 01:41:01 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2013-06-19 01:41:01 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2013-06-19 01:41:01 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2013-06-19 01:41:01 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2013-06-19 01:41:01 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2013-06-19 01:41:02 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2013-06-19 01:41:02 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2013-06-19 01:41:02 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2013-06-19 01:41:02 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2013-06-19 01:41:02 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2013-06-19 01:41:02 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2013-06-19 01:41:02 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2013-06-19 01:41:02 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2013-06-19 01:41:02 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2013-06-19 01:41:03 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2013-06-19 01:41:03 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2013-06-19 01:41:03 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2013-06-19 01:41:03 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2013-06-19 01:41:03 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2013-06-19 01:41:03 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2013-06-19 01:41:03 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2013-06-19 01:41:03 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2013-06-19 01:41:03 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2013-06-19 01:41:04 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2013-06-19 01:41:04 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2013-06-19 01:41:04 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2013-06-19 01:41:04 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2013-06-19 01:41:04 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2013-06-19 01:41:04 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2013-06-19 01:41:04 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2013-06-19 01:41:04 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2013-06-19 01:41:04 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2013-06-19 01:41:05 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2013-06-19 01:41:05 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2013-06-19 01:41:05 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2013-06-19 01:41:05 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2013-06-19 01:41:05 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2013-06-19 01:41:05 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2013-06-19 01:41:05 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2013-06-19 01:41:05 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2013-06-19 01:41:05 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2013-06-19 01:41:05 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2013-06-19 01:41:06 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2013-06-19 01:41:06 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2013-06-19 01:41:06 [INFO    ] Setting Beam 4 xbars
2013-06-19 01:41:06 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2013-06-19 01:41:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2013-06-19 01:41:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2013-06-19 01:41:06 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2013-06-19 01:41:06 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2013-06-19 01:41:06 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2013-06-19 01:41:06 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2013-06-19 01:41:07 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2013-06-19 01:41:07 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2013-06-19 01:41:07 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2013-06-19 01:41:07 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2013-06-19 01:41:07 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2013-06-19 01:41:07 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2013-06-19 01:41:07 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2013-06-19 01:41:07 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2013-06-19 01:41:07 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2013-06-19 01:41:08 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2013-06-19 01:41:08 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2013-06-19 01:41:08 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2013-06-19 01:41:08 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2013-06-19 01:41:08 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2013-06-19 01:41:08 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2013-06-19 01:41:08 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2013-06-19 01:41:08 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2013-06-19 01:41:08 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2013-06-19 01:41:09 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2013-06-19 01:41:09 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2013-06-19 01:41:09 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2013-06-19 01:41:09 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2013-06-19 01:41:09 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2013-06-19 01:41:09 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2013-06-19 01:41:09 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2013-06-19 01:41:09 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2013-06-19 01:41:09 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2013-06-19 01:41:09 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2013-06-19 01:41:10 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2013-06-19 01:41:10 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2013-06-19 01:41:10 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2013-06-19 01:41:10 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2013-06-19 01:41:10 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2013-06-19 01:41:10 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2013-06-19 01:41:10 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2013-06-19 01:41:10 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2013-06-19 01:41:10 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2013-06-19 01:41:11 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2013-06-19 01:41:11 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2013-06-19 01:41:11 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2013-06-19 01:41:11 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2013-06-19 01:41:11 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2013-06-19 01:41:11 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2013-06-19 01:41:11 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2013-06-19 01:41:11 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2013-06-19 01:41:11 [INFO    ] All xbars set
2013-06-19 01:41:11 [INFO    ] Setting adder chain routing for all beams
2013-06-19 01:41:16 [INFO    ] Setting beam ids
2013-06-19 01:41:26 [INFO    ] Starting beam delay calibration
2013-06-19 01:41:38 [INFO    ] Beam 1 latency is 5727
2013-06-19 01:41:38 [INFO    ] Beam 2 latency is 5736
2013-06-19 01:41:38 [INFO    ] Beam 3 latency is 5736
2013-06-19 01:41:38 [INFO    ] Beam 4 latency is 5719
2013-06-19 01:41:38 [INFO    ] Stop calibration
2013-06-19 01:41:46 [INFO    ] Beam delay calibration successful
2013-06-19 01:41:46 [INFO    ] Calibration passed
2013-06-19 01:41:46 [DEBUG   ] spawn_process: at 2013-06-19 01:41:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2013-06-19 01:41:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2013-06-19 01:41:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2013-06-19 01:41:46 [DEBUG   ] spawn_process: at 2013-06-19 01:41:46 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2013-06-19 01:41:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2013-06-19 01:41:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2013-06-19 01:41:46 [DEBUG   ] spawn_process: at 2013-06-19 01:41:46 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2013-06-19 01:41:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2013-06-19 01:41:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2013-06-19 01:41:47 [DEBUG   ] spawn_process: at 2013-06-19 01:41:47 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2013-06-19 01:41:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2013-06-19 01:41:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2013-06-19 01:41:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2013-06-19 01:41:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 213 ms (1371606107.216 s) with PID 25416 and time 1371606106
2013-06-19 01:41:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2013-06-19 01:41:47 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 302 ms (1371606107.306 s) with PID 25419 and time 1371606106
2013-06-19 01:41:48 [DEBUG   ] Finished updating ant stats in 0.931 seconds
2013-06-19 01:41:48 [INFO    ] Started antennas statistics background thread
2013-06-19 01:41:48 [INFO    ] Started board flags background thread
2013-06-19 01:41:48 [INFO    ] Started BAM background thread
2013-06-19 01:41:48 [INFO    ] Finished the INI process (ref. #10548) in 107.709 s
2013-06-19 01:41:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 01:41:50 [DEBUG   ] Finished updating board flags in 2.118 seconds
2013-06-19 01:42:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 01:42:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 01:42:40 [DEBUG   ] Got command RPT from MCS: ref #10549
2013-06-19 01:42:40 [DEBUG   ] summary = NORMAL
2013-06-19 01:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10549  14 56462  6160645 A NORMALNORMAL'
2013-06-19 01:42:40 [DEBUG   ] Got command RPT from MCS: ref #10550
2013-06-19 01:42:40 [DEBUG   ] info = System calibrated and operating normally
2013-06-19 01:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10550  48 56462  6160646 A NORMALSystem calibrated and operating normally'
2013-06-19 01:42:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 01:42:50 [DEBUG   ] Finished updating board flags in 1.989 seconds
2013-06-19 01:43:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 01:43:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 01:43:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 01:43:50 [DEBUG   ] Finished updating board flags in 1.819 seconds
2013-06-19 01:44:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 01:44:28 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 01:44:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 01:44:50 [DEBUG   ] Finished updating board flags in 1.784 seconds
2013-06-19 01:45:00 [DEBUG   ] Got command RPT from MCS: ref #10566
2013-06-19 01:45:00 [DEBUG   ] summary = NORMAL
2013-06-19 01:45:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10566  14 56462  6300897 A NORMALNORMAL'
2013-06-19 01:45:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 01:45:28 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 01:45:48 [DEBUG   ] Finished updating ant stats in 0.387 seconds
2013-06-19 01:45:50 [DEBUG   ] Finished updating board flags in 1.619 seconds
2013-06-19 01:46:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 01:46:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 01:46:49 [DEBUG   ] Finished updating ant stats in 1.233 seconds
2013-06-19 01:46:50 [DEBUG   ] Finished updating board flags in 1.587 seconds
2013-06-19 01:47:09 [DEBUG   ] Finished updating ant stats in 1.171 seconds
2013-06-19 01:47:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 01:47:40 [DEBUG   ] Got command RPT from MCS: ref #10567
2013-06-19 01:47:40 [DEBUG   ] summary = NORMAL
2013-06-19 01:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10567  14 56462  6460641 A NORMALNORMAL'
2013-06-19 01:47:40 [DEBUG   ] Got command RPT from MCS: ref #10568
2013-06-19 01:47:40 [DEBUG   ] info = System calibrated and operating normally
2013-06-19 01:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10568  48 56462  6460642 A NORMALSystem calibrated and operating normally'
2013-06-19 01:47:49 [DEBUG   ] Finished updating ant stats in 0.832 seconds
2013-06-19 01:47:50 [DEBUG   ] Finished updating board flags in 1.422 seconds
2013-06-19 01:48:09 [DEBUG   ] Finished updating ant stats in 0.771 seconds
2013-06-19 01:48:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 01:48:49 [DEBUG   ] Finished updating ant stats in 0.633 seconds
2013-06-19 01:48:50 [DEBUG   ] Finished updating board flags in 1.387 seconds
2013-06-19 01:49:09 [DEBUG   ] Finished updating ant stats in 0.571 seconds
2013-06-19 01:49:29 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 01:49:49 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 01:49:50 [DEBUG   ] Finished updating board flags in 1.210 seconds
2013-06-19 01:50:09 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2013-06-19 01:50:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 01:50:50 [DEBUG   ] Finished updating ant stats in 1.230 seconds
2013-06-19 01:50:50 [DEBUG   ] Finished updating board flags in 1.242 seconds
2013-06-19 01:51:10 [DEBUG   ] Finished updating ant stats in 1.175 seconds
2013-06-19 01:51:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 01:51:50 [DEBUG   ] Finished updating ant stats in 1.030 seconds
2013-06-19 01:51:50 [DEBUG   ] Finished updating board flags in 1.222 seconds
2013-06-19 01:52:10 [DEBUG   ] Finished updating ant stats in 0.975 seconds
2013-06-19 01:52:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 01:52:40 [DEBUG   ] Got command RPT from MCS: ref #10584
2013-06-19 01:52:40 [DEBUG   ] summary = NORMAL
2013-06-19 01:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10584  14 56462  6760649 A NORMALNORMAL'
2013-06-19 01:52:40 [DEBUG   ] Got command RPT from MCS: ref #10585
2013-06-19 01:52:40 [DEBUG   ] info = System calibrated and operating normally
2013-06-19 01:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10585  48 56462  6760650 A NORMALSystem calibrated and operating normally'
2013-06-19 01:52:50 [DEBUG   ] Finished updating ant stats in 0.832 seconds
2013-06-19 01:52:51 [DEBUG   ] Finished updating board flags in 2.142 seconds
2013-06-19 01:53:10 [DEBUG   ] Finished updating ant stats in 0.771 seconds
2013-06-19 01:53:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 01:53:50 [DEBUG   ] Finished updating ant stats in 0.631 seconds
2013-06-19 01:53:51 [DEBUG   ] Finished updating board flags in 2.010 seconds
2013-06-19 01:54:10 [DEBUG   ] Finished updating ant stats in 0.576 seconds
2013-06-19 01:54:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 01:54:50 [DEBUG   ] Finished updating ant stats in 0.432 seconds
2013-06-19 01:54:51 [DEBUG   ] Finished updating board flags in 1.983 seconds
2013-06-19 01:55:10 [DEBUG   ] Finished updating ant stats in 0.371 seconds
2013-06-19 01:55:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 01:55:51 [DEBUG   ] Finished updating ant stats in 1.231 seconds
2013-06-19 01:55:51 [DEBUG   ] Finished updating board flags in 1.879 seconds
2013-06-19 01:56:11 [DEBUG   ] Finished updating ant stats in 1.176 seconds
2013-06-19 01:56:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 01:56:51 [DEBUG   ] Finished updating ant stats in 1.029 seconds
2013-06-19 01:56:51 [DEBUG   ] Finished updating board flags in 1.782 seconds
2013-06-19 01:57:11 [DEBUG   ] Finished updating ant stats in 0.975 seconds
2013-06-19 01:57:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 01:57:40 [DEBUG   ] Got command RPT from MCS: ref #10601
2013-06-19 01:57:40 [DEBUG   ] summary = NORMAL
2013-06-19 01:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10601  14 56462  7060649 A NORMALNORMAL'
2013-06-19 01:57:40 [DEBUG   ] Got command RPT from MCS: ref #10602
2013-06-19 01:57:40 [DEBUG   ] info = System calibrated and operating normally
2013-06-19 01:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10602  48 56462  7060650 A NORMALSystem calibrated and operating normally'
2013-06-19 01:57:51 [DEBUG   ] Finished updating ant stats in 0.830 seconds
2013-06-19 01:57:51 [DEBUG   ] Finished updating board flags in 1.627 seconds
2013-06-19 01:58:11 [DEBUG   ] Finished updating ant stats in 0.775 seconds
2013-06-19 01:58:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 01:58:51 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2013-06-19 01:58:51 [DEBUG   ] Finished updating board flags in 1.565 seconds
2013-06-19 01:59:11 [DEBUG   ] Finished updating ant stats in 0.576 seconds
2013-06-19 01:59:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 01:59:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 01:59:51 [DEBUG   ] Finished updating ant stats in 0.431 seconds
2013-06-19 01:59:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-19 01:59:51 [DEBUG   ] Finished updating board flags in 1.435 seconds
2013-06-19 01:59:58 [DEBUG   ] Got command DRX from MCS: ref #10621
2013-06-19 01:59:58 [INFO    ] sending drx command to lwa34
2013-06-19 01:59:58 [DEBUG   ] run_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa34', '/lwa/software/drx 5 1 25000000.0 7 9 0']
2013-06-19 01:59:58 [DEBUG   ] drx = exited with status True, code 0x00
2013-06-19 01:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    10621   8 56462  7198006 A NORMAL'
2013-06-19 01:59:58 [DEBUG   ] Got command DRX from MCS: ref #10620
2013-06-19 01:59:58 [INFO    ] sending drx command to lwa34
2013-06-19 01:59:58 [DEBUG   ] run_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 62000000.0 7 9 0']
2013-06-19 01:59:58 [DEBUG   ] drx = exited with status True, code 0x00
2013-06-19 01:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    10620   8 56462  7198010 A NORMAL'
2013-06-19 01:59:58 [INFO    ] Finished starting DRX
2013-06-19 01:59:58 [INFO    ] Finished starting DRX
2013-06-19 01:59:58 [DEBUG   ] Got command DRX from MCS: ref #10622
2013-06-19 01:59:58 [INFO    ] sending drx command to lwa34
2013-06-19 01:59:58 [DEBUG   ] run_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 74000000.0 7 9 0']
2013-06-19 01:59:58 [DEBUG   ] drx = exited with status True, code 0x00
2013-06-19 01:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    10622   8 56462  7198134 A NORMAL'
2013-06-19 01:59:58 [INFO    ] Finished starting DRX
2013-06-19 01:59:58 [DEBUG   ] Got command DRX from MCS: ref #10623
2013-06-19 01:59:58 [INFO    ] sending drx command to lwa34
2013-06-19 01:59:58 [DEBUG   ] run_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa34', '/lwa/software/drx 5 2 38000000.0 7 9 0']
2013-06-19 01:59:58 [DEBUG   ] drx = exited with status True, code 0x00
2013-06-19 01:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX    10623   8 56462  7198222 A NORMAL'
2013-06-19 01:59:58 [INFO    ] Finished starting DRX
2013-06-19 01:59:58 [DEBUG   ] Got command BAM from MCS: ref #10625
2013-06-19 01:59:58 [INFO    ] Finished processing BAM request
2013-06-19 01:59:58 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 01:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10625   8 56462  7198310 A NORMAL'
2013-06-19 01:59:58 [DEBUG   ] Got command BAM from MCS: ref #10624
2013-06-19 01:59:58 [INFO    ] Finished processing BAM request
2013-06-19 01:59:58 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 01:59:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10624   8 56462  7198422 A NORMAL'
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2013-06-19 01:59:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2013-06-19 01:59:58 [DEBUG   ] spawn_process: at 2013-06-19 01:59:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2013-06-19 02:00:11 [DEBUG   ] Finished updating ant stats in 0.375 seconds
2013-06-19 02:00:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 02:00:51 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 02:00:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2013-06-19 02:00:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-19 02:00:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 02:00:51 [DEBUG   ] Finished updating board flags in 1.378 seconds
2013-06-19 02:00:52 [DEBUG   ] Got command BAM from MCS: ref #10626
2013-06-19 02:00:52 [INFO    ] Finished processing BAM request
2013-06-19 02:00:52 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:00:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10626   8 56462  7252030 A NORMAL'
2013-06-19 02:00:52 [DEBUG   ] Got command BAM from MCS: ref #10627
2013-06-19 02:00:52 [INFO    ] Finished processing BAM request
2013-06-19 02:00:52 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:00:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10627   8 56462  7252034 A NORMAL'
2013-06-19 02:00:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2013-06-19 02:00:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2013-06-19 02:00:52 [DEBUG   ] spawn_process: at 2013-06-19 02:00:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2013-06-19 02:01:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 02:01:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 02:01:47 [DEBUG   ] Got command BAM from MCS: ref #10628
2013-06-19 02:01:47 [INFO    ] Finished processing BAM request
2013-06-19 02:01:47 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:01:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10628   8 56462  7307034 A NORMAL'
2013-06-19 02:01:47 [DEBUG   ] Got command BAM from MCS: ref #10629
2013-06-19 02:01:47 [INFO    ] Finished processing BAM request
2013-06-19 02:01:47 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:01:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10629   8 56462  7307038 A NORMAL'
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2013-06-19 02:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2013-06-19 02:01:47 [DEBUG   ] spawn_process: at 2013-06-19 02:01:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2013-06-19 02:01:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 02:01:51 [DEBUG   ] Finished updating board flags in 1.210 seconds
2013-06-19 02:01:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 02:02:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 02:02:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 02:02:40 [DEBUG   ] Got command RPT from MCS: ref #10630
2013-06-19 02:02:40 [DEBUG   ] summary = NORMAL
2013-06-19 02:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10630  14 56462  7360646 A NORMALNORMAL'
2013-06-19 02:02:40 [DEBUG   ] Got command RPT from MCS: ref #10631
2013-06-19 02:02:40 [DEBUG   ] info = System calibrated and operating normally
2013-06-19 02:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10631  48 56462  7360646 A NORMALSystem calibrated and operating normally'
2013-06-19 02:02:42 [DEBUG   ] Got command BAM from MCS: ref #10647
2013-06-19 02:02:42 [INFO    ] Finished processing BAM request
2013-06-19 02:02:42 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:02:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10647   8 56462  7362030 A NORMAL'
2013-06-19 02:02:42 [DEBUG   ] Got command BAM from MCS: ref #10648
2013-06-19 02:02:42 [INFO    ] Finished processing BAM request
2013-06-19 02:02:42 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:02:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10648   8 56462  7362034 A NORMAL'
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2013-06-19 02:02:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2013-06-19 02:02:42 [DEBUG   ] spawn_process: at 2013-06-19 02:02:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2013-06-19 02:02:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 02:02:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-06-19 02:02:52 [DEBUG   ] Finished updating ant stats in 1.235 seconds
2013-06-19 02:02:52 [DEBUG   ] Finished updating board flags in 2.261 seconds
2013-06-19 02:03:12 [DEBUG   ] Finished updating ant stats in 1.171 seconds
2013-06-19 02:03:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 02:03:37 [DEBUG   ] Got command BAM from MCS: ref #10649
2013-06-19 02:03:37 [INFO    ] Finished processing BAM request
2013-06-19 02:03:37 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:03:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10649   8 56462  7417034 A NORMAL'
2013-06-19 02:03:37 [DEBUG   ] Got command BAM from MCS: ref #10650
2013-06-19 02:03:37 [INFO    ] Finished processing BAM request
2013-06-19 02:03:37 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:03:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10650   8 56462  7417038 A NORMAL'
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2013-06-19 02:03:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2013-06-19 02:03:37 [DEBUG   ] spawn_process: at 2013-06-19 02:03:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2013-06-19 02:03:52 [DEBUG   ] Finished updating ant stats in 1.034 seconds
2013-06-19 02:03:52 [DEBUG   ] Finished updating board flags in 2.160 seconds
2013-06-19 02:04:12 [DEBUG   ] Finished updating ant stats in 0.971 seconds
2013-06-19 02:04:32 [DEBUG   ] Got command BAM from MCS: ref #10652
2013-06-19 02:04:32 [INFO    ] Finished processing BAM request
2013-06-19 02:04:32 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:04:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10652   8 56462  7472026 A NORMAL'
2013-06-19 02:04:32 [DEBUG   ] Got command BAM from MCS: ref #10651
2013-06-19 02:04:32 [INFO    ] Finished processing BAM request
2013-06-19 02:04:32 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:04:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10651   8 56462  7472030 A NORMAL'
2013-06-19 02:04:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2013-06-19 02:04:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2013-06-19 02:04:32 [DEBUG   ] spawn_process: at 2013-06-19 02:04:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2013-06-19 02:04:52 [DEBUG   ] Finished updating ant stats in 0.630 seconds
2013-06-19 02:04:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 02:04:52 [DEBUG   ] Finished updating board flags in 1.967 seconds
2013-06-19 02:05:12 [DEBUG   ] Finished updating ant stats in 0.575 seconds
2013-06-19 02:05:28 [DEBUG   ] Got command BAM from MCS: ref #10653
2013-06-19 02:05:28 [INFO    ] Finished processing BAM request
2013-06-19 02:05:28 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:05:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10653   8 56462  7528026 A NORMAL'
2013-06-19 02:05:28 [DEBUG   ] Got command BAM from MCS: ref #10654
2013-06-19 02:05:28 [INFO    ] Finished processing BAM request
2013-06-19 02:05:28 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:05:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10654   8 56462  7528030 A NORMAL'
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2013-06-19 02:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2013-06-19 02:05:28 [DEBUG   ] spawn_process: at 2013-06-19 02:05:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2013-06-19 02:05:32 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 02:05:52 [DEBUG   ] Finished updating ant stats in 0.431 seconds
2013-06-19 02:05:52 [DEBUG   ] Finished updating board flags in 1.831 seconds
2013-06-19 02:06:12 [DEBUG   ] Finished updating ant stats in 0.375 seconds
2013-06-19 02:06:24 [DEBUG   ] Got command BAM from MCS: ref #10655
2013-06-19 02:06:24 [INFO    ] Finished processing BAM request
2013-06-19 02:06:24 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:06:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10655   8 56462  7584026 A NORMAL'
2013-06-19 02:06:24 [DEBUG   ] Got command BAM from MCS: ref #10656
2013-06-19 02:06:24 [INFO    ] Finished processing BAM request
2013-06-19 02:06:24 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:06:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10656   8 56462  7584030 A NORMAL'
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2013-06-19 02:06:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2013-06-19 02:06:24 [DEBUG   ] spawn_process: at 2013-06-19 02:06:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2013-06-19 02:06:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 02:06:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2013-06-19 02:06:52 [DEBUG   ] Finished updating board flags in 1.782 seconds
2013-06-19 02:06:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 02:07:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 02:07:20 [DEBUG   ] Got command BAM from MCS: ref #10657
2013-06-19 02:07:20 [INFO    ] Finished processing BAM request
2013-06-19 02:07:20 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:07:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10657   8 56462  7640026 A NORMAL'
2013-06-19 02:07:20 [DEBUG   ] Got command BAM from MCS: ref #10658
2013-06-19 02:07:20 [INFO    ] Finished processing BAM request
2013-06-19 02:07:20 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:07:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10658   8 56462  7640030 A NORMAL'
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2013-06-19 02:07:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2013-06-19 02:07:20 [DEBUG   ] spawn_process: at 2013-06-19 02:07:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2013-06-19 02:07:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 02:07:40 [DEBUG   ] Got command RPT from MCS: ref #10659
2013-06-19 02:07:40 [DEBUG   ] summary = NORMAL
2013-06-19 02:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10659  14 56462  7660646 A NORMALNORMAL'
2013-06-19 02:07:40 [DEBUG   ] Got command RPT from MCS: ref #10660
2013-06-19 02:07:40 [DEBUG   ] info = System calibrated and operating normally
2013-06-19 02:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10660  48 56462  7660646 A NORMALSystem calibrated and operating normally'
2013-06-19 02:07:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 02:07:53 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 02:07:53 [DEBUG   ] Finished updating board flags in 2.568 seconds
2013-06-19 02:08:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 02:08:16 [DEBUG   ] Got command BAM from MCS: ref #10676
2013-06-19 02:08:16 [INFO    ] Finished processing BAM request
2013-06-19 02:08:16 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:08:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10676   8 56462  7696026 A NORMAL'
2013-06-19 02:08:16 [DEBUG   ] Got command BAM from MCS: ref #10677
2013-06-19 02:08:16 [INFO    ] Finished processing BAM request
2013-06-19 02:08:16 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:08:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10677   8 56462  7696030 A NORMAL'
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2013-06-19 02:08:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2013-06-19 02:08:16 [DEBUG   ] spawn_process: at 2013-06-19 02:08:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2013-06-19 02:08:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 02:08:52 [DEBUG   ] Finished updating board flags in 1.414 seconds
2013-06-19 02:08:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 02:09:13 [DEBUG   ] Got command BAM from MCS: ref #10678
2013-06-19 02:09:13 [INFO    ] Finished processing BAM request
2013-06-19 02:09:13 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:09:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10678   8 56462  7753034 A NORMAL'
2013-06-19 02:09:13 [DEBUG   ] Got command BAM from MCS: ref #10679
2013-06-19 02:09:13 [INFO    ] Finished processing BAM request
2013-06-19 02:09:13 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:09:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10679   8 56462  7753038 A NORMAL'
2013-06-19 02:09:13 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2013-06-19 02:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2013-06-19 02:09:13 [DEBUG   ] spawn_process: at 2013-06-19 02:09:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2013-06-19 02:09:33 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 02:09:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 02:09:52 [DEBUG   ] Finished updating board flags in 1.419 seconds
2013-06-19 02:09:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 02:10:10 [DEBUG   ] Got command BAM from MCS: ref #10680
2013-06-19 02:10:10 [INFO    ] Finished processing BAM request
2013-06-19 02:10:10 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:10:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10680   8 56462  7810030 A NORMAL'
2013-06-19 02:10:10 [DEBUG   ] Got command BAM from MCS: ref #10681
2013-06-19 02:10:10 [INFO    ] Finished processing BAM request
2013-06-19 02:10:10 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:10:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10681   8 56462  7810034 A NORMAL'
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2013-06-19 02:10:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2013-06-19 02:10:10 [DEBUG   ] spawn_process: at 2013-06-19 02:10:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2013-06-19 02:10:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 02:10:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 02:10:52 [DEBUG   ] Finished updating board flags in 1.387 seconds
2013-06-19 02:10:53 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 02:11:07 [DEBUG   ] Got command BAM from MCS: ref #10682
2013-06-19 02:11:07 [INFO    ] Finished processing BAM request
2013-06-19 02:11:07 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:11:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10682   8 56462  7867026 A NORMAL'
2013-06-19 02:11:07 [DEBUG   ] Got command BAM from MCS: ref #10683
2013-06-19 02:11:07 [INFO    ] Finished processing BAM request
2013-06-19 02:11:07 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:11:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10683   8 56462  7867030 A NORMAL'
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2013-06-19 02:11:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2013-06-19 02:11:07 [DEBUG   ] spawn_process: at 2013-06-19 02:11:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2013-06-19 02:11:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 02:11:33 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 02:11:52 [DEBUG   ] Finished updating board flags in 1.195 seconds
2013-06-19 02:11:53 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 02:12:05 [DEBUG   ] Got command BAM from MCS: ref #10684
2013-06-19 02:12:05 [INFO    ] Finished processing BAM request
2013-06-19 02:12:05 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:12:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10684   8 56462  7925030 A NORMAL'
2013-06-19 02:12:05 [DEBUG   ] Got command BAM from MCS: ref #10685
2013-06-19 02:12:05 [INFO    ] Finished processing BAM request
2013-06-19 02:12:05 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:12:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10685   8 56462  7925034 A NORMAL'
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2013-06-19 02:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2013-06-19 02:12:05 [DEBUG   ] spawn_process: at 2013-06-19 02:12:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2013-06-19 02:12:13 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 02:12:33 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 02:12:40 [DEBUG   ] Got command RPT from MCS: ref #10686
2013-06-19 02:12:40 [DEBUG   ] summary = NORMAL
2013-06-19 02:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10686  14 56462  7960650 A NORMALNORMAL'
2013-06-19 02:12:40 [DEBUG   ] Got command RPT from MCS: ref #10687
2013-06-19 02:12:40 [DEBUG   ] info = System calibrated and operating normally
2013-06-19 02:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10687  48 56462  7960650 A NORMALSystem calibrated and operating normally'
2013-06-19 02:12:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa1, chip 1
2013-06-19 02:12:53 [DEBUG   ] Finished updating ant stats in 0.431 seconds
2013-06-19 02:12:53 [DEBUG   ] Finished updating board flags in 2.078 seconds
2013-06-19 02:13:03 [DEBUG   ] Got command BAM from MCS: ref #10704
2013-06-19 02:13:03 [INFO    ] Finished processing BAM request
2013-06-19 02:13:03 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:13:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10704   8 56462  7983034 A NORMAL'
2013-06-19 02:13:03 [DEBUG   ] Got command BAM from MCS: ref #10703
2013-06-19 02:13:03 [INFO    ] Finished processing BAM request
2013-06-19 02:13:03 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:13:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10703   8 56462  7983038 A NORMAL'
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2013-06-19 02:13:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2013-06-19 02:13:03 [DEBUG   ] spawn_process: at 2013-06-19 02:13:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2013-06-19 02:13:13 [DEBUG   ] Finished updating ant stats in 0.376 seconds
2013-06-19 02:13:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 02:13:53 [DEBUG   ] Finished updating board flags in 1.971 seconds
2013-06-19 02:13:54 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 02:14:01 [DEBUG   ] Got command BAM from MCS: ref #10705
2013-06-19 02:14:01 [INFO    ] Finished processing BAM request
2013-06-19 02:14:01 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10705   8 56462  8041025 A NORMAL'
2013-06-19 02:14:01 [DEBUG   ] Got command BAM from MCS: ref #10706
2013-06-19 02:14:01 [INFO    ] Finished processing BAM request
2013-06-19 02:14:01 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10706   8 56462  8041029 A NORMAL'
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2013-06-19 02:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2013-06-19 02:14:01 [DEBUG   ] spawn_process: at 2013-06-19 02:14:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2013-06-19 02:14:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 02:14:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 02:14:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2013-06-19 02:14:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 02:14:53 [DEBUG   ] Finished updating board flags in 1.789 seconds
2013-06-19 02:14:54 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 02:15:00 [DEBUG   ] Got command BAM from MCS: ref #10707
2013-06-19 02:15:00 [INFO    ] Finished processing BAM request
2013-06-19 02:15:00 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10707   8 56462  8100025 A NORMAL'
2013-06-19 02:15:00 [DEBUG   ] Got command BAM from MCS: ref #10708
2013-06-19 02:15:00 [INFO    ] Finished processing BAM request
2013-06-19 02:15:00 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10708   8 56462  8100029 A NORMAL'
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2013-06-19 02:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2013-06-19 02:15:00 [DEBUG   ] spawn_process: at 2013-06-19 02:15:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2013-06-19 02:15:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 02:15:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 02:15:53 [DEBUG   ] Finished updating board flags in 1.605 seconds
2013-06-19 02:15:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 02:15:59 [DEBUG   ] Got command BAM from MCS: ref #10709
2013-06-19 02:15:59 [INFO    ] Finished processing BAM request
2013-06-19 02:15:59 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:15:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10709   8 56462  8159033 A NORMAL'
2013-06-19 02:15:59 [DEBUG   ] Got command BAM from MCS: ref #10710
2013-06-19 02:15:59 [INFO    ] Finished processing BAM request
2013-06-19 02:15:59 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:15:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10710   8 56462  8159037 A NORMAL'
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2013-06-19 02:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2013-06-19 02:15:59 [DEBUG   ] spawn_process: at 2013-06-19 02:15:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2013-06-19 02:16:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 02:16:34 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2013-06-19 02:16:53 [DEBUG   ] Finished updating board flags in 1.554 seconds
2013-06-19 02:16:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 02:16:58 [DEBUG   ] Got command BAM from MCS: ref #10711
2013-06-19 02:16:58 [INFO    ] Finished processing BAM request
2013-06-19 02:16:58 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:16:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10711   8 56462  8218033 A NORMAL'
2013-06-19 02:16:58 [DEBUG   ] Got command BAM from MCS: ref #10712
2013-06-19 02:16:58 [INFO    ] Finished processing BAM request
2013-06-19 02:16:58 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:16:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10712   8 56462  8218037 A NORMAL'
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2013-06-19 02:16:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2013-06-19 02:16:58 [DEBUG   ] spawn_process: at 2013-06-19 02:16:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2013-06-19 02:17:15 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2013-06-19 02:17:35 [DEBUG   ] Finished updating ant stats in 0.992 seconds
2013-06-19 02:17:40 [DEBUG   ] Got command RPT from MCS: ref #10713
2013-06-19 02:17:40 [DEBUG   ] summary = NORMAL
2013-06-19 02:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10713  14 56462  8260653 A NORMALNORMAL'
2013-06-19 02:17:40 [DEBUG   ] Got command RPT from MCS: ref #10714
2013-06-19 02:17:40 [DEBUG   ] info = System calibrated and operating normally
2013-06-19 02:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10714  48 56462  8260654 A NORMALSystem calibrated and operating normally'
2013-06-19 02:17:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 02:17:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-06-19 02:17:53 [DEBUG   ] Finished updating board flags in 1.411 seconds
2013-06-19 02:17:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 02:17:57 [DEBUG   ] Got command BAM from MCS: ref #10731
2013-06-19 02:17:57 [INFO    ] Finished processing BAM request
2013-06-19 02:17:57 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:17:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10731   8 56462  8277033 A NORMAL'
2013-06-19 02:17:57 [DEBUG   ] Got command BAM from MCS: ref #10730
2013-06-19 02:17:57 [INFO    ] Finished processing BAM request
2013-06-19 02:17:57 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:17:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10730   8 56462  8277037 A NORMAL'
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2013-06-19 02:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2013-06-19 02:17:57 [DEBUG   ] spawn_process: at 2013-06-19 02:17:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2013-06-19 02:18:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 02:18:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 02:18:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 02:18:53 [DEBUG   ] Finished updating board flags in 1.389 seconds
2013-06-19 02:18:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 02:18:57 [DEBUG   ] Got command BAM from MCS: ref #10732
2013-06-19 02:18:57 [INFO    ] Finished processing BAM request
2013-06-19 02:18:57 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:18:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10732   8 56462  8337033 A NORMAL'
2013-06-19 02:18:57 [DEBUG   ] Got command BAM from MCS: ref #10733
2013-06-19 02:18:57 [INFO    ] Finished processing BAM request
2013-06-19 02:18:57 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:18:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10733   8 56462  8337037 A NORMAL'
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2013-06-19 02:18:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2013-06-19 02:18:57 [DEBUG   ] spawn_process: at 2013-06-19 02:18:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2013-06-19 02:19:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 02:19:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 02:19:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 02:19:53 [DEBUG   ] Finished updating board flags in 1.246 seconds
2013-06-19 02:19:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 02:19:57 [DEBUG   ] Got command BAM from MCS: ref #10735
2013-06-19 02:19:57 [INFO    ] Finished processing BAM request
2013-06-19 02:19:57 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:19:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10735   8 56462  8397033 A NORMAL'
2013-06-19 02:19:57 [DEBUG   ] Got command BAM from MCS: ref #10734
2013-06-19 02:19:57 [INFO    ] Finished processing BAM request
2013-06-19 02:19:57 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:19:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10734   8 56462  8397037 A NORMAL'
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2013-06-19 02:19:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2013-06-19 02:19:57 [DEBUG   ] spawn_process: at 2013-06-19 02:19:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2013-06-19 02:20:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 02:20:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 02:20:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 02:20:53 [DEBUG   ] Finished updating board flags in 1.164 seconds
2013-06-19 02:20:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 02:20:57 [DEBUG   ] Got command BAM from MCS: ref #10737
2013-06-19 02:20:57 [INFO    ] Finished processing BAM request
2013-06-19 02:20:57 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:20:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10737   8 56462  8457030 A NORMAL'
2013-06-19 02:20:57 [DEBUG   ] Got command BAM from MCS: ref #10736
2013-06-19 02:20:57 [INFO    ] Finished processing BAM request
2013-06-19 02:20:57 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:20:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10736   8 56462  8457034 A NORMAL'
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2013-06-19 02:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2013-06-19 02:20:57 [DEBUG   ] spawn_process: at 2013-06-19 02:20:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2013-06-19 02:21:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 02:21:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 02:21:54 [DEBUG   ] Finished updating board flags in 1.999 seconds
2013-06-19 02:21:55 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 02:21:58 [DEBUG   ] Got command BAM from MCS: ref #10738
2013-06-19 02:21:58 [INFO    ] Finished processing BAM request
2013-06-19 02:21:58 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:21:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10738   8 56462  8518029 A NORMAL'
2013-06-19 02:21:58 [DEBUG   ] Got command BAM from MCS: ref #10739
2013-06-19 02:21:58 [INFO    ] Finished processing BAM request
2013-06-19 02:21:58 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:21:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10739   8 56462  8518033 A NORMAL'
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2013-06-19 02:21:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2013-06-19 02:21:58 [DEBUG   ] spawn_process: at 2013-06-19 02:21:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2013-06-19 02:22:15 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 02:22:35 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 02:22:40 [DEBUG   ] Got command RPT from MCS: ref #10740
2013-06-19 02:22:40 [DEBUG   ] summary = NORMAL
2013-06-19 02:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10740  14 56462  8560649 A NORMALNORMAL'
2013-06-19 02:22:40 [DEBUG   ] Got command RPT from MCS: ref #10741
2013-06-19 02:22:40 [DEBUG   ] info = System calibrated and operating normally
2013-06-19 02:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10741  48 56462  8560650 A NORMALSystem calibrated and operating normally'
2013-06-19 02:22:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 02:22:54 [DEBUG   ] Finished updating board flags in 1.812 seconds
2013-06-19 02:22:55 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-19 02:22:59 [DEBUG   ] Got command BAM from MCS: ref #10757
2013-06-19 02:22:59 [INFO    ] Finished processing BAM request
2013-06-19 02:22:59 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:22:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10757   8 56462  8579025 A NORMAL'
2013-06-19 02:22:59 [DEBUG   ] Got command BAM from MCS: ref #10758
2013-06-19 02:22:59 [INFO    ] Finished processing BAM request
2013-06-19 02:22:59 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:22:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10758   8 56462  8579029 A NORMAL'
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2013-06-19 02:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2013-06-19 02:22:59 [DEBUG   ] spawn_process: at 2013-06-19 02:22:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2013-06-19 02:23:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 02:23:36 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 02:23:54 [DEBUG   ] Finished updating board flags in 1.776 seconds
2013-06-19 02:23:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 02:24:00 [DEBUG   ] Got command BAM from MCS: ref #10759
2013-06-19 02:24:00 [INFO    ] Finished processing BAM request
2013-06-19 02:24:00 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:24:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10759   8 56462  8640033 A NORMAL'
2013-06-19 02:24:00 [DEBUG   ] Got command BAM from MCS: ref #10760
2013-06-19 02:24:00 [INFO    ] Finished processing BAM request
2013-06-19 02:24:00 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:24:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10760   8 56462  8640037 A NORMAL'
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2013-06-19 02:24:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2013-06-19 02:24:00 [DEBUG   ] spawn_process: at 2013-06-19 02:24:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2013-06-19 02:24:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 02:24:36 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 02:24:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-06-19 02:24:54 [DEBUG   ] Finished updating board flags in 1.613 seconds
2013-06-19 02:24:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 02:25:01 [DEBUG   ] Got command BAM from MCS: ref #10762
2013-06-19 02:25:01 [INFO    ] Finished processing BAM request
2013-06-19 02:25:01 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:25:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10762   8 56462  8701029 A NORMAL'
2013-06-19 02:25:01 [DEBUG   ] Got command BAM from MCS: ref #10761
2013-06-19 02:25:01 [INFO    ] Finished processing BAM request
2013-06-19 02:25:01 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:25:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10761   8 56462  8701033 A NORMAL'
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2013-06-19 02:25:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2013-06-19 02:25:01 [DEBUG   ] spawn_process: at 2013-06-19 02:25:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2013-06-19 02:25:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 02:25:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 02:25:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2013-06-19 02:25:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 02:25:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 02:25:54 [DEBUG   ] Finished updating board flags in 1.589 seconds
2013-06-19 02:25:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 02:26:03 [DEBUG   ] Got command BAM from MCS: ref #10764
2013-06-19 02:26:03 [INFO    ] Finished processing BAM request
2013-06-19 02:26:03 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:26:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10764   8 56462  8763029 A NORMAL'
2013-06-19 02:26:03 [DEBUG   ] Got command BAM from MCS: ref #10763
2013-06-19 02:26:03 [INFO    ] Finished processing BAM request
2013-06-19 02:26:03 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:26:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10763   8 56462  8763033 A NORMAL'
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2013-06-19 02:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2013-06-19 02:26:03 [DEBUG   ] spawn_process: at 2013-06-19 02:26:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2013-06-19 02:26:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 02:26:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 02:26:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2013-06-19 02:26:54 [DEBUG   ] Finished updating board flags in 1.412 seconds
2013-06-19 02:26:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 02:27:05 [DEBUG   ] Got command BAM from MCS: ref #10766
2013-06-19 02:27:05 [INFO    ] Finished processing BAM request
2013-06-19 02:27:05 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:27:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10766   8 56462  8825026 A NORMAL'
2013-06-19 02:27:05 [DEBUG   ] Got command BAM from MCS: ref #10765
2013-06-19 02:27:05 [INFO    ] Finished processing BAM request
2013-06-19 02:27:05 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:27:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10765   8 56462  8825029 A NORMAL'
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2013-06-19 02:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2013-06-19 02:27:05 [DEBUG   ] spawn_process: at 2013-06-19 02:27:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2013-06-19 02:27:16 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-19 02:27:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 02:27:40 [DEBUG   ] Got command RPT from MCS: ref #10767
2013-06-19 02:27:40 [DEBUG   ] summary = NORMAL
2013-06-19 02:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10767  14 56462  8860661 A NORMALNORMAL'
2013-06-19 02:27:40 [DEBUG   ] Got command RPT from MCS: ref #10768
2013-06-19 02:27:40 [DEBUG   ] info = System calibrated and operating normally
2013-06-19 02:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10768  48 56462  8860662 A NORMALSystem calibrated and operating normally'
2013-06-19 02:27:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 02:27:54 [DEBUG   ] Finished updating board flags in 1.388 seconds
2013-06-19 02:27:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 02:28:06 [DEBUG   ] Got command BAM from MCS: ref #10784
2013-06-19 02:28:06 [INFO    ] Finished processing BAM request
2013-06-19 02:28:06 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:28:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10784   8 56462  8886029 A NORMAL'
2013-06-19 02:28:06 [DEBUG   ] Got command BAM from MCS: ref #10785
2013-06-19 02:28:06 [INFO    ] Finished processing BAM request
2013-06-19 02:28:06 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:28:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10785   8 56462  8886033 A NORMAL'
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2013-06-19 02:28:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2013-06-19 02:28:06 [DEBUG   ] spawn_process: at 2013-06-19 02:28:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2013-06-19 02:28:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 02:28:37 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2013-06-19 02:28:54 [DEBUG   ] Finished updating board flags in 1.204 seconds
2013-06-19 02:28:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 02:29:07 [DEBUG   ] Got command BAM from MCS: ref #10787
2013-06-19 02:29:07 [INFO    ] Finished processing BAM request
2013-06-19 02:29:07 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:29:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10787   8 56462  8947025 A NORMAL'
2013-06-19 02:29:07 [DEBUG   ] Got command BAM from MCS: ref #10786
2013-06-19 02:29:07 [INFO    ] Finished processing BAM request
2013-06-19 02:29:07 [DEBUG   ] bam = exited with status True, code 0x00
2013-06-19 02:29:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM    10786   8 56462  8947029 A NORMAL'
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2013-06-19 02:29:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2013-06-19 02:29:07 [DEBUG   ] spawn_process: at 2013-06-19 02:29:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2013-06-19 02:29:17 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 02:29:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-19 02:29:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-19 02:29:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-19 02:29:54 [DEBUG   ] Finished updating board flags in 1.208 seconds
2013-06-19 02:29:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 02:30:17 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-19 02:30:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-19 02:30:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-19 02:30:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-19 02:30:54 [DEBUG   ] Finished updating board flags in 1.207 seconds
2013-06-19 02:30:57 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 02:31:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 02:31:37 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 02:31:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2013-06-19 02:31:54 [DEBUG   ] Finished updating board flags in 1.199 seconds
2013-06-19 02:31:57 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-19 02:32:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 02:32:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 02:32:40 [DEBUG   ] Got command RPT from MCS: ref #10788
2013-06-19 02:32:40 [DEBUG   ] summary = NORMAL
2013-06-19 02:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10788  14 56462  9160653 A NORMALNORMAL'
2013-06-19 02:32:40 [DEBUG   ] Got command RPT from MCS: ref #10789
2013-06-19 02:32:40 [DEBUG   ] info = System calibrated and operating normally
2013-06-19 02:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10789  48 56462  9160654 A NORMALSystem calibrated and operating normally'
2013-06-19 02:32:55 [DEBUG   ] Finished updating board flags in 1.997 seconds
2013-06-19 02:32:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 02:33:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 02:33:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 02:33:55 [DEBUG   ] Finished updating board flags in 1.809 seconds
2013-06-19 02:33:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 02:34:18 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-19 02:34:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 02:34:55 [DEBUG   ] Finished updating board flags in 1.783 seconds
2013-06-19 02:34:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 02:35:00 [DEBUG   ] Got command INI from MCS: ref #10805
2013-06-19 02:35:00 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2013-06-19 02:35:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI    10805   8 56462  9300917 ABOOTING'
2013-06-19 02:35:21 [INFO    ] -------------------
2013-06-19 02:35:21 [INFO    ]  LWA board status
2013-06-19 02:35:21 [INFO    ] -------------------
2013-06-19 02:35:21 [INFO    ] DP 1: 2 lwa27
2013-06-19 02:35:21 [INFO    ] DP 1: 3 lwa24
2013-06-19 02:35:21 [INFO    ] DP 1: 4 lwa23
2013-06-19 02:35:21 [INFO    ] DP 1: 5 lwa18
2013-06-19 02:35:21 [INFO    ] DP 1: 6 lwa10
2013-06-19 02:35:21 [INFO    ] DP 1: 7 lwa32
2013-06-19 02:35:21 [INFO    ] DP 1: 8 lwa11
2013-06-19 02:35:21 [INFO    ] DP 1: 9 lwa30
2013-06-19 02:35:21 [INFO    ] DP 1: 10 lwa12
2013-06-19 02:35:21 [INFO    ] DP 1: 11 lwa8
2013-06-19 02:35:21 [INFO    ] DP 1: 12 lwa13
2013-06-19 02:35:21 [INFO    ] DP 1: 13 lwa26
2013-06-19 02:35:21 [INFO    ] DP 1: 14 lwa14
2013-06-19 02:35:21 [INFO    ] DP 1: 16 lwa22
2013-06-19 02:35:21 [INFO    ] DP 1: 17 lwa20
2013-06-19 02:35:21 [INFO    ] DP 1: 18 lwa1
2013-06-19 02:35:21 [INFO    ] DP 1: 19 lwa5
2013-06-19 02:35:21 [INFO    ] DP 1: 20 lwa25
2013-06-19 02:35:21 [INFO    ] DP 1: 21 lwa35
2013-06-19 02:35:21 [INFO    ] DP 1: 22 lwa19
2013-06-19 02:35:21 [INFO    ] DP 1: 23 lwa21
2013-06-19 02:35:21 [INFO    ] DP 1: 24 lwa6
2013-06-19 02:35:21 [INFO    ] DP 1: 25 lwa7
2013-06-19 02:35:21 [INFO    ] DP 1: 26 lwa33
2013-06-19 02:35:21 [INFO    ] DP 1: 27 lwa15
2013-06-19 02:35:21 [INFO    ] DP 1: 28 lwa28
2013-06-19 02:35:21 [INFO    ] DP 2: 1 lwa16
2013-06-19 02:35:21 [INFO    ] DP 2: 15 lwa34
2013-06-19 02:35:21 [INFO    ] Total of 28 boards
2013-06-19 02:35:21 [INFO    ] Total of 260 stands
2013-06-19 02:35:21 [INFO    ] -------------------
2013-06-19 02:35:21 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:22 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:23 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:24 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:25 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32559
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32560
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32561
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32562
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32563
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32564
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32565
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32566
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32567
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32568
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32569
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32570
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32571
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32572
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32573
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32574
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32575
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32576
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32577
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32578
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32579
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32580
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32581
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32582
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32583
2013-06-19 02:35:28 [DEBUG   ] 2013-06-19 02:35:28 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 32584
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32559 exited with status 0
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32560 exited with status 0
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32561 exited with status 0
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32562 exited with status 0
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32563 exited with status 0
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32564 exited with status 0
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32565 exited with status 0
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32566 exited with status 0
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32567 exited with status 0
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32568 exited with status 0
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32569 exited with status 0
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32570 exited with status 0
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32571 exited with status 0
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32572 exited with status 0
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32573 exited with status 0
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32574 exited with status 0
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32575 exited with status 0
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32576 exited with status 0
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32577 exited with status 0
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32578 exited with status 0
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32579 exited with status 0
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32580 exited with status 0
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32581 exited with status 0
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32582 exited with status 0
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32583 exited with status 0
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 32584 exited with status 0
2013-06-19 02:35:40 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] spawn_process: at 2013-06-19 02:35:40 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 32611
2013-06-19 02:35:40 [DEBUG   ] 2013-06-19 02:35:40 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 32612
2013-06-19 02:35:46 [DEBUG   ] 2013-06-19 02:35:46 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 32611 exited with status 0
2013-06-19 02:35:46 [DEBUG   ] 2013-06-19 02:35:46 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 32612 exited with status 0
2013-06-19 02:35:46 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2013-06-19 02:35:46 [DEBUG   ] spawn_process: at 2013-06-19 02:35:46 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2013-06-19 02:35:46 [DEBUG   ] spawn_process: at 2013-06-19 02:35:46 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2013-06-19 02:35:46 [INFO    ] Setting Beam 1 xbars
2013-06-19 02:35:46 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2013-06-19 02:35:46 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2013-06-19 02:35:46 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2013-06-19 02:35:46 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2013-06-19 02:35:47 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2013-06-19 02:35:47 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2013-06-19 02:35:47 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2013-06-19 02:35:47 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2013-06-19 02:35:47 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2013-06-19 02:35:47 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2013-06-19 02:35:47 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2013-06-19 02:35:47 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2013-06-19 02:35:47 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2013-06-19 02:35:47 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2013-06-19 02:35:48 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2013-06-19 02:35:48 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2013-06-19 02:35:48 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2013-06-19 02:35:48 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2013-06-19 02:35:48 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2013-06-19 02:35:48 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2013-06-19 02:35:48 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2013-06-19 02:35:48 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2013-06-19 02:35:48 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2013-06-19 02:35:49 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2013-06-19 02:35:49 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2013-06-19 02:35:49 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2013-06-19 02:35:49 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2013-06-19 02:35:49 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2013-06-19 02:35:49 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2013-06-19 02:35:49 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2013-06-19 02:35:49 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2013-06-19 02:35:49 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2013-06-19 02:35:50 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2013-06-19 02:35:50 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2013-06-19 02:35:50 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2013-06-19 02:35:50 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2013-06-19 02:35:50 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2013-06-19 02:35:50 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2013-06-19 02:35:50 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2013-06-19 02:35:50 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2013-06-19 02:35:50 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2013-06-19 02:35:51 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2013-06-19 02:35:51 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2013-06-19 02:35:51 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2013-06-19 02:35:51 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2013-06-19 02:35:51 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2013-06-19 02:35:51 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2013-06-19 02:35:51 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2013-06-19 02:35:51 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2013-06-19 02:35:51 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2013-06-19 02:35:51 [INFO    ] Setting Beam 2 xbars
2013-06-19 02:35:51 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2013-06-19 02:35:52 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2013-06-19 02:35:52 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2013-06-19 02:35:52 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2013-06-19 02:35:52 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2013-06-19 02:35:52 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2013-06-19 02:35:52 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2013-06-19 02:35:52 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2013-06-19 02:35:52 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2013-06-19 02:35:52 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2013-06-19 02:35:53 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2013-06-19 02:35:53 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2013-06-19 02:35:53 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2013-06-19 02:35:53 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2013-06-19 02:35:53 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2013-06-19 02:35:53 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2013-06-19 02:35:53 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2013-06-19 02:35:53 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2013-06-19 02:35:53 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2013-06-19 02:35:54 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2013-06-19 02:35:54 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2013-06-19 02:35:54 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2013-06-19 02:35:54 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2013-06-19 02:35:54 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2013-06-19 02:35:54 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2013-06-19 02:35:54 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2013-06-19 02:35:54 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2013-06-19 02:35:54 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2013-06-19 02:35:55 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2013-06-19 02:35:55 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2013-06-19 02:35:55 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2013-06-19 02:35:55 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2013-06-19 02:35:55 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2013-06-19 02:35:55 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2013-06-19 02:35:55 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2013-06-19 02:35:55 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2013-06-19 02:35:55 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2013-06-19 02:35:55 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2013-06-19 02:35:56 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2013-06-19 02:35:56 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2013-06-19 02:35:56 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2013-06-19 02:35:56 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2013-06-19 02:35:56 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2013-06-19 02:35:56 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2013-06-19 02:35:56 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2013-06-19 02:35:56 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2013-06-19 02:35:56 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2013-06-19 02:35:57 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2013-06-19 02:35:57 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2013-06-19 02:35:57 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2013-06-19 02:35:57 [INFO    ] Setting Beam 3 xbars
2013-06-19 02:35:57 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2013-06-19 02:35:57 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2013-06-19 02:35:57 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2013-06-19 02:35:57 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2013-06-19 02:35:57 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2013-06-19 02:35:57 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2013-06-19 02:35:58 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2013-06-19 02:35:58 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2013-06-19 02:35:58 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2013-06-19 02:35:58 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2013-06-19 02:35:58 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2013-06-19 02:35:58 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2013-06-19 02:35:58 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2013-06-19 02:35:58 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2013-06-19 02:35:58 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2013-06-19 02:35:59 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2013-06-19 02:35:59 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2013-06-19 02:35:59 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2013-06-19 02:35:59 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2013-06-19 02:35:59 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2013-06-19 02:35:59 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2013-06-19 02:35:59 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2013-06-19 02:35:59 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2013-06-19 02:35:59 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2013-06-19 02:36:00 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2013-06-19 02:36:00 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2013-06-19 02:36:00 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2013-06-19 02:36:00 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2013-06-19 02:36:00 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2013-06-19 02:36:00 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2013-06-19 02:36:00 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2013-06-19 02:36:00 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2013-06-19 02:36:00 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2013-06-19 02:36:00 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2013-06-19 02:36:01 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2013-06-19 02:36:01 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2013-06-19 02:36:01 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2013-06-19 02:36:01 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2013-06-19 02:36:01 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2013-06-19 02:36:01 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2013-06-19 02:36:01 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2013-06-19 02:36:01 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2013-06-19 02:36:01 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2013-06-19 02:36:02 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2013-06-19 02:36:02 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2013-06-19 02:36:02 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2013-06-19 02:36:02 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2013-06-19 02:36:02 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2013-06-19 02:36:02 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2013-06-19 02:36:02 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2013-06-19 02:36:02 [INFO    ] Setting Beam 4 xbars
2013-06-19 02:36:02 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2013-06-19 02:36:02 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2013-06-19 02:36:03 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2013-06-19 02:36:03 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2013-06-19 02:36:03 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2013-06-19 02:36:03 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2013-06-19 02:36:03 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2013-06-19 02:36:03 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2013-06-19 02:36:03 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2013-06-19 02:36:03 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2013-06-19 02:36:03 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2013-06-19 02:36:04 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2013-06-19 02:36:04 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2013-06-19 02:36:04 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2013-06-19 02:36:04 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2013-06-19 02:36:04 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2013-06-19 02:36:04 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2013-06-19 02:36:04 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2013-06-19 02:36:04 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2013-06-19 02:36:04 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2013-06-19 02:36:05 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2013-06-19 02:36:05 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2013-06-19 02:36:05 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2013-06-19 02:36:05 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2013-06-19 02:36:05 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2013-06-19 02:36:05 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2013-06-19 02:36:05 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2013-06-19 02:36:05 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2013-06-19 02:36:05 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2013-06-19 02:36:05 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2013-06-19 02:36:06 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2013-06-19 02:36:06 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2013-06-19 02:36:06 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2013-06-19 02:36:06 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2013-06-19 02:36:06 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2013-06-19 02:36:06 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2013-06-19 02:36:06 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2013-06-19 02:36:06 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2013-06-19 02:36:06 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2013-06-19 02:36:07 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2013-06-19 02:36:07 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2013-06-19 02:36:07 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2013-06-19 02:36:07 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2013-06-19 02:36:07 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2013-06-19 02:36:07 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2013-06-19 02:36:07 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2013-06-19 02:36:07 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2013-06-19 02:36:07 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2013-06-19 02:36:08 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2013-06-19 02:36:08 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2013-06-19 02:36:08 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2013-06-19 02:36:08 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2013-06-19 02:36:08 [INFO    ] All xbars set
2013-06-19 02:36:08 [INFO    ] Setting adder chain routing for all beams
2013-06-19 02:36:13 [INFO    ] Setting beam ids
2013-06-19 02:36:23 [INFO    ] Starting beam delay calibration
2013-06-19 02:36:35 [INFO    ] Beam 1 latency is 5517
2013-06-19 02:36:35 [INFO    ] Beam 2 latency is 5547
2013-06-19 02:36:35 [INFO    ] Beam 3 latency is 5542
2013-06-19 02:36:35 [INFO    ] Beam 4 latency is 5522
2013-06-19 02:36:35 [INFO    ] Stop calibration
2013-06-19 02:36:43 [INFO    ] Beam delay calibration successful
2013-06-19 02:36:43 [INFO    ] Calibration passed
2013-06-19 02:36:43 [DEBUG   ] spawn_process: at 2013-06-19 02:36:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2013-06-19 02:36:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2013-06-19 02:36:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2013-06-19 02:36:43 [DEBUG   ] spawn_process: at 2013-06-19 02:36:43 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2013-06-19 02:36:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2013-06-19 02:36:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2013-06-19 02:36:43 [DEBUG   ] spawn_process: at 2013-06-19 02:36:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2013-06-19 02:36:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2013-06-19 02:36:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2013-06-19 02:36:43 [DEBUG   ] spawn_process: at 2013-06-19 02:36:43 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2013-06-19 02:36:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2013-06-19 02:36:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2013-06-19 02:36:43 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -4 msec
2013-06-19 02:36:44 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 83 ms (1371609404.087 s) with PID 1729 and time 1371609403
2013-06-19 02:36:44 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -4 msec
2013-06-19 02:36:44 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 172 ms (1371609404.176 s) with PID 1732 and time 1371609403
2013-06-19 02:36:45 [INFO    ] Started antennas statistics background thread
2013-06-19 02:36:45 [INFO    ] Started board flags background thread
2013-06-19 02:36:45 [INFO    ] Started BAM background thread
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-19 02:36:45 [DEBUG   ] Finished updating ant stats in 1.103 seconds
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-19 02:36:45 [INFO    ] Finished the INI process (ref. #10805) in 104.381 s
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-19 02:36:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-19 02:36:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-19 02:36:46 [DEBUG   ] Finished updating board flags in 1.267 seconds
2013-06-19 02:37:05 [DEBUG   ] Finished updating ant stats in 0.972 seconds
2013-06-19 02:37:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 02:37:40 [DEBUG   ] Got command RPT from MCS: ref #10806
2013-06-19 02:37:40 [DEBUG   ] summary = NORMAL
2013-06-19 02:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10806  14 56462  9460661 A NORMALNORMAL'
2013-06-19 02:37:40 [DEBUG   ] Got command RPT from MCS: ref #10807
2013-06-19 02:37:40 [DEBUG   ] info = System calibrated and operating normally
2013-06-19 02:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10807  48 56462  9460662 A NORMALSystem calibrated and operating normally'
2013-06-19 02:37:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-19 02:37:45 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-19 02:37:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-19 02:37:46 [DEBUG   ] Finished updating board flags in 1.196 seconds
2013-06-19 02:38:05 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 02:38:25 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-19 02:38:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 02:38:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 02:38:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 02:38:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 02:38:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 02:38:46 [DEBUG   ] Finished updating ant stats in 1.231 seconds
2013-06-19 02:38:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 02:38:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 02:38:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 02:38:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 02:38:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 02:38:47 [DEBUG   ] Finished updating board flags in 1.997 seconds
2013-06-19 02:39:06 [DEBUG   ] Finished updating ant stats in 1.172 seconds
2013-06-19 02:39:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 02:39:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 02:39:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 02:39:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 02:39:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 02:39:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 02:39:46 [DEBUG   ] Finished updating ant stats in 0.829 seconds
2013-06-19 02:39:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 02:39:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 02:39:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 02:39:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 02:39:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 02:39:47 [DEBUG   ] Finished updating board flags in 1.809 seconds
2013-06-19 02:40:00 [DEBUG   ] Got command RPT from MCS: ref #10823
2013-06-19 02:40:00 [DEBUG   ] summary = NORMAL
2013-06-19 02:40:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10823  14 56462  9600913 A NORMALNORMAL'
2013-06-19 02:40:06 [DEBUG   ] Finished updating ant stats in 0.773 seconds
2013-06-19 02:40:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 02:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 02:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 02:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 02:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 02:40:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 02:40:46 [DEBUG   ] Finished updating ant stats in 0.429 seconds
2013-06-19 02:40:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 02:40:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 02:40:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 02:40:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 02:40:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 02:40:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 02:40:47 [DEBUG   ] Finished updating board flags in 1.782 seconds
2013-06-19 02:41:06 [DEBUG   ] Finished updating ant stats in 0.372 seconds
2013-06-19 02:41:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 02:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 02:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 02:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 02:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 02:41:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 02:41:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 02:41:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 02:41:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 02:41:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 02:41:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 02:41:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 02:41:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 02:41:47 [DEBUG   ] Finished updating ant stats in 1.228 seconds
2013-06-19 02:41:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 02:41:47 [DEBUG   ] Finished updating board flags in 1.677 seconds
2013-06-19 02:42:07 [DEBUG   ] Finished updating ant stats in 1.172 seconds
2013-06-19 02:42:27 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 02:42:40 [DEBUG   ] Got command RPT from MCS: ref #10824
2013-06-19 02:42:40 [DEBUG   ] summary = NORMAL
2013-06-19 02:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10824  14 56462  9760665 A NORMALNORMAL'
2013-06-19 02:42:40 [DEBUG   ] Got command RPT from MCS: ref #10825
2013-06-19 02:42:40 [DEBUG   ] info = System calibrated and operating normally
2013-06-19 02:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10825  48 56462  9760666 A NORMALSystem calibrated and operating normally'
2013-06-19 02:42:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 02:42:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 02:42:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 02:42:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 02:42:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 02:42:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 02:42:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 02:42:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 02:42:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 02:42:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 02:42:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-19 02:42:47 [DEBUG   ] Finished updating ant stats in 0.826 seconds
2013-06-19 02:42:47 [DEBUG   ] Finished updating board flags in 1.578 seconds
2013-06-19 02:43:07 [DEBUG   ] Finished updating ant stats in 0.776 seconds
2013-06-19 02:43:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 02:43:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 02:43:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 02:43:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 02:43:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 02:43:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 02:43:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 02:43:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 02:43:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 02:43:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 02:43:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 02:43:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 02:43:47 [DEBUG   ] Finished updating ant stats in 0.627 seconds
2013-06-19 02:43:47 [DEBUG   ] Finished updating board flags in 1.427 seconds
2013-06-19 02:44:07 [DEBUG   ] Finished updating ant stats in 0.576 seconds
2013-06-19 02:44:27 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-19 02:44:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 02:44:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 02:44:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 02:44:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 02:44:46 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 02:44:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 02:44:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 02:44:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 02:44:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 02:44:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 02:44:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-19 02:44:47 [DEBUG   ] Finished updating ant stats in 0.422 seconds
2013-06-19 02:44:47 [DEBUG   ] Finished updating board flags in 1.389 seconds
2013-06-19 02:45:00 [DEBUG   ] Got command TBN from MCS: ref #10841
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '1', '1371609902']
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '2', '1371609902']
2013-06-19 02:45:00 [DEBUG   ] tbn = exited with status True, code 0x00
2013-06-19 02:45:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN    10841   8 56462  9900918 A NORMAL'
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '3', '1371609902']
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '4', '1371609902']
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '5', '1371609902']
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '6', '1371609902']
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '7', '1371609902']
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '8', '1371609902']
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '9', '1371609902']
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '10', '1371609902']
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '11', '1371609902']
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '12', '1371609902']
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '13', '1371609902']
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '14', '1371609902']
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '15', '1371609902']
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '16', '1371609902']
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '17', '1371609902']
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '18', '1371609902']
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '19', '1371609902']
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '20', '1371609902']
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '21', '1371609902']
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '22', '1371609902']
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '23', '1371609902']
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '24', '1371609902']
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '25', '1371609902']
2013-06-19 02:45:00 [DEBUG   ] spawn_process: at 2013-06-19 02:45:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '37900000.0', '7', '20', '0', '26', '1371609902']
2013-06-19 02:45:00 [INFO    ] Finished spawning TBN in 0.050 s
2013-06-19 02:45:07 [DEBUG   ] Finished updating ant stats in 0.444 seconds
2013-06-19 02:45:27 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-19 02:45:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 02:45:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 02:45:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 02:45:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 02:45:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 02:45:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 02:45:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 02:45:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 02:45:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 02:45:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 02:45:48 [DEBUG   ] Finished updating ant stats in 1.444 seconds
2013-06-19 02:45:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-06-19 02:45:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 02:45:48 [CRITICAL] MGT underflow detected on beam(s) 1
2013-06-19 02:45:48 [DEBUG   ] Finished updating board flags in 2.382 seconds
2013-06-19 02:46:08 [DEBUG   ] Finished updating ant stats in 1.360 seconds
2013-06-19 02:46:28 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 02:46:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 02:46:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 02:46:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 02:46:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 02:46:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 02:46:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 02:46:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 02:46:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 02:46:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 02:46:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 02:46:48 [DEBUG   ] Finished updating ant stats in 1.247 seconds
2013-06-19 02:46:48 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 02:46:48 [DEBUG   ] Finished updating board flags in 2.239 seconds
2013-06-19 02:47:08 [DEBUG   ] Finished updating ant stats in 1.157 seconds
2013-06-19 02:47:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 02:47:40 [DEBUG   ] Got command RPT from MCS: ref #10842
2013-06-19 02:47:40 [DEBUG   ] summary = ERROR
2013-06-19 02:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10842  13 56462 10060665 A  ERRORERROR'
2013-06-19 02:47:40 [DEBUG   ] Got command RPT from MCS: ref #10843
2013-06-19 02:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 02:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10843  77 56462 10060666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 02:47:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 02:47:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 02:47:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 02:47:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 02:47:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 02:47:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 02:47:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 02:47:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 02:47:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 02:47:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 02:47:48 [DEBUG   ] Finished updating ant stats in 0.850 seconds
2013-06-19 02:47:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-19 02:47:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 02:47:48 [DEBUG   ] Finished updating board flags in 2.215 seconds
2013-06-19 02:48:08 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2013-06-19 02:48:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 02:48:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 02:48:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 02:48:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 02:48:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 02:48:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 02:48:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 02:48:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 02:48:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 02:48:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 02:48:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 02:48:48 [DEBUG   ] Finished updating ant stats in 0.638 seconds
2013-06-19 02:48:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-06-19 02:48:48 [CRITICAL] MGT underflow detected on beam(s) 1
2013-06-19 02:48:48 [DEBUG   ] Finished updating board flags in 2.189 seconds
2013-06-19 02:49:08 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2013-06-19 02:49:28 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-19 02:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 02:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 02:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 02:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 02:49:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 02:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 02:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 02:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 02:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 02:49:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 02:49:48 [DEBUG   ] Finished updating board flags in 2.016 seconds
2013-06-19 02:49:49 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-19 02:50:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 02:50:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-19 02:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 02:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 02:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 02:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 02:50:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 02:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 02:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 02:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 02:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 02:50:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 02:50:48 [DEBUG   ] Finished updating board flags in 2.012 seconds
2013-06-19 02:50:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 02:51:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 02:51:29 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 02:51:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 02:51:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 02:51:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 02:51:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 02:51:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 02:51:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 02:51:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 02:51:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 02:51:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 02:51:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 02:51:48 [DEBUG   ] Finished updating board flags in 2.021 seconds
2013-06-19 02:51:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 02:52:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 02:52:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 02:52:40 [DEBUG   ] Got command RPT from MCS: ref #10859
2013-06-19 02:52:40 [DEBUG   ] summary = ERROR
2013-06-19 02:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10859  13 56462 10360661 A  ERRORERROR'
2013-06-19 02:52:40 [DEBUG   ] Got command RPT from MCS: ref #10860
2013-06-19 02:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 02:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10860  77 56462 10360662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 02:52:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 02:52:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 02:52:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 02:52:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 02:52:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 02:52:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 02:52:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 02:52:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 02:52:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 02:52:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 02:52:48 [DEBUG   ] Finished updating board flags in 1.978 seconds
2013-06-19 02:52:49 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2013-06-19 02:53:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 02:53:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 02:53:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 02:53:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 02:53:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 02:53:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 02:53:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 02:53:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 02:53:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 02:53:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 02:53:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 02:53:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 02:53:48 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 02:53:48 [DEBUG   ] Finished updating board flags in 1.789 seconds
2013-06-19 02:53:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 02:54:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 02:54:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 02:54:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 02:54:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 02:54:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 02:54:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 02:54:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 02:54:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 02:54:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 02:54:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 02:54:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 02:54:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 02:54:48 [DEBUG   ] Finished updating board flags in 1.535 seconds
2013-06-19 02:54:49 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 02:55:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 02:55:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 02:55:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 02:55:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 02:55:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 02:55:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 02:55:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 02:55:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 02:55:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 02:55:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 02:55:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 02:55:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 02:55:48 [DEBUG   ] Finished updating board flags in 1.414 seconds
2013-06-19 02:55:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 02:56:09 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 02:56:29 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 02:56:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 02:56:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 02:56:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 02:56:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 02:56:47 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 02:56:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 02:56:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 02:56:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 02:56:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 02:56:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 02:56:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 02:56:48 [DEBUG   ] Finished updating board flags in 1.439 seconds
2013-06-19 02:56:50 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-06-19 02:57:10 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-19 02:57:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 02:57:40 [DEBUG   ] Got command RPT from MCS: ref #10876
2013-06-19 02:57:40 [DEBUG   ] summary = ERROR
2013-06-19 02:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10876  13 56462 10660661 A  ERRORERROR'
2013-06-19 02:57:40 [DEBUG   ] Got command RPT from MCS: ref #10877
2013-06-19 02:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 02:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10877  77 56462 10660662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 02:57:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 02:57:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 02:57:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 02:57:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 02:57:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 02:57:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 02:57:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 02:57:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 02:57:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 02:57:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 02:57:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 02:57:49 [DEBUG   ] Finished updating board flags in 2.418 seconds
2013-06-19 02:57:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 02:58:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-19 02:58:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 02:58:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 02:58:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 02:58:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 02:58:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 02:58:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 02:58:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-19 02:58:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 02:58:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 02:58:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 02:58:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 02:58:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 02:58:50 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2013-06-19 02:58:50 [DEBUG   ] Finished updating board flags in 3.297 seconds
2013-06-19 02:59:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 02:59:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 02:59:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 02:59:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 02:59:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 02:59:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 02:59:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 02:59:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 02:59:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 02:59:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 02:59:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 02:59:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 02:59:49 [DEBUG   ] Finished updating board flags in 2.301 seconds
2013-06-19 02:59:50 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 03:00:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 03:00:30 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 03:00:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:00:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:00:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:00:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:00:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:00:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:00:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:00:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:00:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:00:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:00:49 [DEBUG   ] Finished updating board flags in 2.195 seconds
2013-06-19 03:00:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 03:01:10 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 03:01:30 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 03:01:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:01:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:01:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:01:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:01:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:01:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:01:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:01:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:01:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:01:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:01:49 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 03:01:49 [DEBUG   ] Finished updating board flags in 2.037 seconds
2013-06-19 03:01:50 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 03:02:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 03:02:30 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 03:02:40 [DEBUG   ] Got command RPT from MCS: ref #10893
2013-06-19 03:02:40 [DEBUG   ] summary = ERROR
2013-06-19 03:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10893  13 56462 10960661 A  ERRORERROR'
2013-06-19 03:02:40 [DEBUG   ] Got command RPT from MCS: ref #10894
2013-06-19 03:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 03:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10894  77 56462 10960662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 03:02:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:02:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:02:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:02:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:02:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:02:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:02:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:02:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:02:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:02:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:02:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 03:02:49 [DEBUG   ] Finished updating board flags in 1.980 seconds
2013-06-19 03:02:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 03:03:10 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 03:03:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 03:03:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:03:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:03:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:03:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:03:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:03:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:03:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:03:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:03:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:03:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:03:49 [DEBUG   ] Finished updating board flags in 1.735 seconds
2013-06-19 03:03:50 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 03:04:10 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-19 03:04:31 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-19 03:04:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:04:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:04:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:04:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:04:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:04:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:04:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:04:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:04:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:04:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:04:49 [DEBUG   ] Finished updating board flags in 1.616 seconds
2013-06-19 03:04:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 03:05:11 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 03:05:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 03:05:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:05:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:05:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:05:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:05:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:05:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:05:49 [DEBUG   ] Finished updating board flags in 1.586 seconds
2013-06-19 03:05:51 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 03:06:11 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 03:06:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 03:06:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:06:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:06:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:06:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:06:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:06:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:06:49 [DEBUG   ] Finished updating board flags in 1.413 seconds
2013-06-19 03:06:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 03:07:11 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 03:07:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 03:07:40 [DEBUG   ] Got command RPT from MCS: ref #10910
2013-06-19 03:07:40 [DEBUG   ] summary = ERROR
2013-06-19 03:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10910  13 56462 11260669 A  ERRORERROR'
2013-06-19 03:07:40 [DEBUG   ] Got command RPT from MCS: ref #10911
2013-06-19 03:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 03:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10911  77 56462 11260670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 03:07:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:07:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:07:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:07:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:07:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:07:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:07:49 [DEBUG   ] Finished updating board flags in 1.408 seconds
2013-06-19 03:07:51 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-06-19 03:08:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 03:08:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 03:08:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:08:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:08:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:08:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:08:48 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:08:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:08:49 [DEBUG   ] Finished updating board flags in 1.383 seconds
2013-06-19 03:08:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 03:09:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 03:09:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 03:09:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:09:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:09:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:09:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:09:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:09:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:09:50 [DEBUG   ] Finished updating board flags in 2.261 seconds
2013-06-19 03:09:51 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2013-06-19 03:10:12 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-19 03:10:32 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2013-06-19 03:10:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:10:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:10:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:10:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:10:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:10:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:10:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 03:10:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 03:10:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 03:10:50 [DEBUG   ] Finished updating board flags in 2.145 seconds
2013-06-19 03:10:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 03:11:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 03:11:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-19 03:11:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:11:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:11:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:11:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:11:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:11:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:11:50 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 03:11:50 [DEBUG   ] Finished updating board flags in 2.009 seconds
2013-06-19 03:11:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-19 03:12:12 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 03:12:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 03:12:40 [DEBUG   ] Got command RPT from MCS: ref #10927
2013-06-19 03:12:40 [DEBUG   ] summary = ERROR
2013-06-19 03:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10927  13 56462 11560661 A  ERRORERROR'
2013-06-19 03:12:40 [DEBUG   ] Got command RPT from MCS: ref #10928
2013-06-19 03:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 03:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10928  77 56462 11560662 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 03:12:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:12:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:12:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:12:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:12:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:12:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:12:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:12:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:12:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:12:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:12:50 [DEBUG   ] Finished updating board flags in 1.992 seconds
2013-06-19 03:12:52 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 03:13:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-19 03:13:32 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 03:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:13:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:13:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:13:50 [DEBUG   ] Finished updating board flags in 1.866 seconds
2013-06-19 03:13:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 03:14:12 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2013-06-19 03:14:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 03:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:14:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:14:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:14:50 [DEBUG   ] Finished updating board flags in 1.809 seconds
2013-06-19 03:14:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 03:15:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 03:15:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 03:15:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:15:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:15:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:15:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:15:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:15:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:15:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 03:15:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 03:15:50 [DEBUG   ] Finished updating board flags in 1.723 seconds
2013-06-19 03:15:52 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-19 03:16:12 [DEBUG   ] Finished updating ant stats in 0.581 seconds
2013-06-19 03:16:33 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-19 03:16:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:16:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:16:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:16:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:16:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:16:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:16:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:16:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:16:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:16:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:16:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 03:16:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 03:16:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 03:16:50 [DEBUG   ] Finished updating board flags in 1.523 seconds
2013-06-19 03:16:53 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-19 03:17:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 03:17:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 03:17:40 [DEBUG   ] Got command RPT from MCS: ref #10944
2013-06-19 03:17:40 [DEBUG   ] summary = ERROR
2013-06-19 03:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10944  13 56462 11860669 A  ERRORERROR'
2013-06-19 03:17:40 [DEBUG   ] Got command RPT from MCS: ref #10945
2013-06-19 03:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 03:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10945  77 56462 11860670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 03:17:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:17:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:17:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:17:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:17:49 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:17:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:17:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:17:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:17:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:17:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:17:50 [DEBUG   ] Finished updating board flags in 1.386 seconds
2013-06-19 03:17:53 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 03:18:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-19 03:18:33 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 03:18:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:18:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:18:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:18:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:18:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:18:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:18:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-06-19 03:18:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 03:18:51 [CRITICAL] MGT underflow detected on beam(s) 1
2013-06-19 03:18:51 [DEBUG   ] Finished updating board flags in 2.264 seconds
2013-06-19 03:18:53 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2013-06-19 03:19:13 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2013-06-19 03:19:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 03:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:19:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:19:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:19:51 [DEBUG   ] Finished updating board flags in 2.217 seconds
2013-06-19 03:19:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 03:20:13 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 03:20:33 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-19 03:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:20:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:20:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:20:51 [DEBUG   ] Finished updating board flags in 2.128 seconds
2013-06-19 03:20:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 03:21:13 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 03:21:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 03:21:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:21:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:21:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:21:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:21:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:21:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:21:51 [DEBUG   ] Finished updating board flags in 2.018 seconds
2013-06-19 03:21:53 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 03:22:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 03:22:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 03:22:40 [DEBUG   ] Got command RPT from MCS: ref #10961
2013-06-19 03:22:40 [DEBUG   ] summary = ERROR
2013-06-19 03:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10961  13 56462 12160673 A  ERRORERROR'
2013-06-19 03:22:40 [DEBUG   ] Got command RPT from MCS: ref #10962
2013-06-19 03:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 03:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10962  77 56462 12160674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 03:22:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:22:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:22:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:22:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:22:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:22:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:22:51 [DEBUG   ] Finished updating board flags in 1.982 seconds
2013-06-19 03:22:53 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 03:23:14 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-19 03:23:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 03:23:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:23:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:23:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:23:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:23:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:23:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:23:51 [DEBUG   ] Finished updating board flags in 1.823 seconds
2013-06-19 03:23:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 03:24:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 03:24:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-19 03:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:24:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:24:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:24:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-19 03:24:51 [DEBUG   ] Finished updating board flags in 1.790 seconds
2013-06-19 03:24:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 03:25:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 03:25:34 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 03:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:25:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:25:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:25:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 03:25:51 [DEBUG   ] Finished updating board flags in 1.609 seconds
2013-06-19 03:25:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 03:26:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 03:26:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 03:26:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:26:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:26:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:26:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:26:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:26:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:26:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 03:26:51 [DEBUG   ] Finished updating board flags in 1.607 seconds
2013-06-19 03:26:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 03:27:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 03:27:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 03:27:40 [DEBUG   ] Got command RPT from MCS: ref #10978
2013-06-19 03:27:40 [DEBUG   ] summary = ERROR
2013-06-19 03:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10978  13 56462 12460665 A  ERRORERROR'
2013-06-19 03:27:40 [DEBUG   ] Got command RPT from MCS: ref #10979
2013-06-19 03:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 03:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10979  77 56462 12460666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 03:27:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:27:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:27:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:27:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:27:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:27:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:27:51 [DEBUG   ] Finished updating board flags in 1.592 seconds
2013-06-19 03:27:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 03:28:14 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 03:28:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 03:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:28:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:28:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:28:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-19 03:28:51 [DEBUG   ] Finished updating board flags in 1.411 seconds
2013-06-19 03:28:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 03:29:15 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2013-06-19 03:29:34 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-19 03:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:29:50 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:29:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:29:51 [DEBUG   ] Finished updating board flags in 1.390 seconds
2013-06-19 03:29:54 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-06-19 03:30:14 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-19 03:30:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-19 03:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:30:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:30:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:30:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 03:30:52 [DEBUG   ] Finished updating board flags in 2.211 seconds
2013-06-19 03:30:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 03:31:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 03:31:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 03:31:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:31:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:31:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:31:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:31:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:31:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:31:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 03:31:52 [DEBUG   ] Finished updating board flags in 2.209 seconds
2013-06-19 03:31:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 03:32:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 03:32:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 03:32:40 [DEBUG   ] Got command RPT from MCS: ref #10995
2013-06-19 03:32:40 [DEBUG   ] summary = ERROR
2013-06-19 03:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10995  13 56462 12760665 A  ERRORERROR'
2013-06-19 03:32:40 [DEBUG   ] Got command RPT from MCS: ref #10996
2013-06-19 03:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 03:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    10996  77 56462 12760666 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 03:32:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:32:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:32:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:32:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:32:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:32:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:32:52 [DEBUG   ] Finished updating board flags in 2.233 seconds
2013-06-19 03:32:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 03:33:15 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2013-06-19 03:33:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 03:33:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:33:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:33:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:33:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:33:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:33:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:33:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-06-19 03:33:52 [CRITICAL] MGT underflow detected on beam(s) 1
2013-06-19 03:33:52 [DEBUG   ] Finished updating board flags in 2.208 seconds
2013-06-19 03:33:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 03:34:15 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 03:34:36 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-19 03:34:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:34:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:34:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:34:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:34:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:34:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:34:52 [DEBUG   ] Finished updating board flags in 2.155 seconds
2013-06-19 03:34:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 03:35:16 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-19 03:35:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-19 03:35:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:35:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:35:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:35:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:35:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:35:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:35:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-06-19 03:35:52 [CRITICAL] MGT underflow detected on beam(s) 1
2013-06-19 03:35:52 [DEBUG   ] Finished updating board flags in 2.011 seconds
2013-06-19 03:35:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 03:36:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 03:36:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 03:36:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:36:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:36:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:36:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:36:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:36:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:36:52 [DEBUG   ] Finished updating board flags in 1.987 seconds
2013-06-19 03:36:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 03:37:16 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 03:37:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 03:37:40 [DEBUG   ] Got command RPT from MCS: ref #11012
2013-06-19 03:37:40 [DEBUG   ] summary = ERROR
2013-06-19 03:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11012  13 56462 13060669 A  ERRORERROR'
2013-06-19 03:37:40 [DEBUG   ] Got command RPT from MCS: ref #11013
2013-06-19 03:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 03:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11013  77 56462 13060670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 03:37:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:37:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:37:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:37:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:37:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:37:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:37:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:37:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:37:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:37:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:37:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 03:37:52 [DEBUG   ] Finished updating board flags in 1.881 seconds
2013-06-19 03:37:56 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2013-06-19 03:38:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 03:38:36 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 03:38:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:38:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:38:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:38:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:38:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:38:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:38:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:38:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:38:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:38:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:38:52 [DEBUG   ] Finished updating board flags in 1.728 seconds
2013-06-19 03:38:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 03:39:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 03:39:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 03:39:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:39:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:39:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:39:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:39:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:39:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:39:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:39:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:39:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:39:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:39:52 [DEBUG   ] Finished updating board flags in 1.621 seconds
2013-06-19 03:39:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 03:40:16 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 03:40:36 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2013-06-19 03:40:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:40:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:40:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:40:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:40:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:40:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:40:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 03:40:52 [DEBUG   ] Finished updating board flags in 1.577 seconds
2013-06-19 03:40:57 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-19 03:41:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 03:41:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 03:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:41:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:41:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:41:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 03:41:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 03:41:52 [DEBUG   ] Finished updating board flags in 1.415 seconds
2013-06-19 03:41:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-19 03:42:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 03:42:37 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 03:42:40 [DEBUG   ] Got command RPT from MCS: ref #11029
2013-06-19 03:42:40 [DEBUG   ] summary = ERROR
2013-06-19 03:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11029  13 56462 13360678 A  ERRORERROR'
2013-06-19 03:42:40 [DEBUG   ] Got command RPT from MCS: ref #11030
2013-06-19 03:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 03:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11030  77 56462 13360678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 03:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:42:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:42:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:42:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 03:42:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 03:42:52 [DEBUG   ] Finished updating board flags in 1.414 seconds
2013-06-19 03:42:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 03:43:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 03:43:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 03:43:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:43:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:43:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:43:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:43:51 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:43:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:43:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:43:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:43:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:43:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:43:52 [DEBUG   ] Finished updating board flags in 1.378 seconds
2013-06-19 03:43:57 [DEBUG   ] Finished updating ant stats in 0.764 seconds
2013-06-19 03:44:17 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 03:44:38 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-19 03:44:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:44:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:44:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:44:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:44:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:44:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:44:53 [DEBUG   ] Finished updating board flags in 2.218 seconds
2013-06-19 03:44:58 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 03:45:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 03:45:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-19 03:45:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:45:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:45:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:45:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:45:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:45:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:45:53 [DEBUG   ] Finished updating board flags in 2.191 seconds
2013-06-19 03:45:58 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 03:46:18 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 03:46:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 03:46:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:46:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:46:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:46:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:46:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:46:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:46:53 [DEBUG   ] Finished updating board flags in 2.014 seconds
2013-06-19 03:46:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 03:47:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 03:47:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 03:47:40 [DEBUG   ] Got command RPT from MCS: ref #11046
2013-06-19 03:47:40 [DEBUG   ] summary = ERROR
2013-06-19 03:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11046  13 56462 13660669 A  ERRORERROR'
2013-06-19 03:47:40 [DEBUG   ] Got command RPT from MCS: ref #11047
2013-06-19 03:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 03:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11047  77 56462 13660670 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 03:47:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:47:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:47:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:47:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:47:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:47:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:47:53 [DEBUG   ] Finished updating board flags in 1.992 seconds
2013-06-19 03:47:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 03:48:18 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 03:48:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 03:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:48:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:48:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:48:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 03:48:53 [DEBUG   ] Finished updating board flags in 1.810 seconds
2013-06-19 03:48:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 03:49:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 03:49:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 03:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:49:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:49:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:49:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 03:49:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 03:49:53 [DEBUG   ] Finished updating board flags in 1.793 seconds
2013-06-19 03:49:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 03:50:19 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-19 03:50:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 03:50:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:50:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:50:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:50:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:50:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:50:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:50:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 03:50:53 [DEBUG   ] Finished updating board flags in 1.602 seconds
2013-06-19 03:50:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 03:51:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 03:51:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 03:51:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:51:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:51:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:51:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:51:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:51:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-19 03:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:51:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:51:53 [DEBUG   ] Finished updating board flags in 1.608 seconds
2013-06-19 03:51:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 03:52:19 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2013-06-19 03:52:39 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2013-06-19 03:52:40 [DEBUG   ] Got command RPT from MCS: ref #11063
2013-06-19 03:52:40 [DEBUG   ] summary = ERROR
2013-06-19 03:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11063  13 56462 13960673 A  ERRORERROR'
2013-06-19 03:52:40 [DEBUG   ] Got command RPT from MCS: ref #11064
2013-06-19 03:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 03:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11064  77 56462 13960674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 03:52:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:52:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:52:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:52:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:52:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:52:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:52:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 03:52:53 [DEBUG   ] Finished updating board flags in 1.586 seconds
2013-06-19 03:52:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 03:53:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 03:53:39 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 03:53:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:53:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:53:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:53:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:53:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:53:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:53:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 03:53:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 03:53:53 [DEBUG   ] Finished updating board flags in 1.414 seconds
2013-06-19 03:53:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 03:54:19 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2013-06-19 03:54:39 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 03:54:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:54:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:54:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:54:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:54:52 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:54:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:54:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 03:54:53 [DEBUG   ] Finished updating board flags in 1.388 seconds
2013-06-19 03:54:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 03:55:20 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-19 03:55:40 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-19 03:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:55:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:55:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:55:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-19 03:55:54 [DEBUG   ] Finished updating board flags in 2.227 seconds
2013-06-19 03:56:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 03:56:20 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 03:56:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 03:56:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:56:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:56:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:56:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:56:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:56:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:56:54 [DEBUG   ] Finished updating board flags in 2.184 seconds
2013-06-19 03:57:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 03:57:20 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 03:57:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 03:57:40 [DEBUG   ] Got command RPT from MCS: ref #11080
2013-06-19 03:57:40 [DEBUG   ] summary = ERROR
2013-06-19 03:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11080  13 56462 14260677 A  ERRORERROR'
2013-06-19 03:57:40 [DEBUG   ] Got command RPT from MCS: ref #11081
2013-06-19 03:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 03:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11081  77 56462 14260678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 03:57:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:57:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:57:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:57:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:57:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:57:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:57:54 [DEBUG   ] Finished updating board flags in 2.012 seconds
2013-06-19 03:58:00 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2013-06-19 03:58:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 03:58:40 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 03:58:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:58:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:58:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:58:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:58:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:58:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:58:54 [DEBUG   ] Finished updating board flags in 2.051 seconds
2013-06-19 03:59:00 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2013-06-19 03:59:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 03:59:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 03:59:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 03:59:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 03:59:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 03:59:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 03:59:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 03:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 03:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 03:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 03:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 03:59:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 03:59:54 [DEBUG   ] Finished updating board flags in 1.954 seconds
2013-06-19 04:00:00 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2013-06-19 04:00:20 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 04:00:41 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-19 04:00:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:00:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:00:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:00:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:00:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:00:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:00:54 [DEBUG   ] Finished updating board flags in 1.813 seconds
2013-06-19 04:01:01 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-19 04:01:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 04:01:41 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2013-06-19 04:01:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:01:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:01:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:01:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:01:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:01:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:01:54 [DEBUG   ] Finished updating board flags in 1.796 seconds
2013-06-19 04:02:01 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 04:02:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 04:02:40 [DEBUG   ] Got command RPT from MCS: ref #11097
2013-06-19 04:02:40 [DEBUG   ] summary = ERROR
2013-06-19 04:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11097  13 56462 14560681 A  ERRORERROR'
2013-06-19 04:02:40 [DEBUG   ] Got command RPT from MCS: ref #11098
2013-06-19 04:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 04:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11098  77 56462 14560682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 04:02:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 04:02:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:02:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:02:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:02:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:02:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:02:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:02:54 [DEBUG   ] Finished updating board flags in 1.595 seconds
2013-06-19 04:03:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 04:03:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 04:03:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 04:03:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:03:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:03:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:03:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:03:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:03:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:03:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 04:03:54 [DEBUG   ] Finished updating board flags in 1.415 seconds
2013-06-19 04:04:01 [DEBUG   ] Finished updating ant stats in 0.606 seconds
2013-06-19 04:04:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 04:04:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 04:04:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:04:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:04:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:04:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:04:53 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:04:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:04:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 04:04:54 [DEBUG   ] Finished updating board flags in 1.385 seconds
2013-06-19 04:05:01 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 04:05:21 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2013-06-19 04:05:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 04:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:05:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:05:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:05:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 04:05:55 [DEBUG   ] Finished updating board flags in 2.217 seconds
2013-06-19 04:06:02 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 04:06:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 04:06:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 04:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:06:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:06:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:06:55 [DEBUG   ] Finished updating board flags in 2.226 seconds
2013-06-19 04:07:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 04:07:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 04:07:40 [DEBUG   ] Got command RPT from MCS: ref #11114
2013-06-19 04:07:40 [DEBUG   ] summary = ERROR
2013-06-19 04:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11114  13 56462 14860677 A  ERRORERROR'
2013-06-19 04:07:40 [DEBUG   ] Got command RPT from MCS: ref #11115
2013-06-19 04:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 04:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11115  77 56462 14860678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 04:07:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 04:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:07:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:07:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:07:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-19 04:07:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 04:07:55 [DEBUG   ] Finished updating board flags in 2.158 seconds
2013-06-19 04:08:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 04:08:22 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 04:08:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 04:08:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:08:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:08:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:08:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:08:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:08:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:08:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 04:08:55 [DEBUG   ] Finished updating board flags in 2.012 seconds
2013-06-19 04:09:02 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-19 04:09:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 04:09:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 04:09:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:09:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:09:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:09:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:09:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:09:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:09:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:09:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:09:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:09:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:09:55 [DEBUG   ] Finished updating board flags in 2.067 seconds
2013-06-19 04:10:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 04:10:22 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-06-19 04:10:43 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-19 04:10:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:10:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:10:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:10:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:10:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:10:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:10:55 [DEBUG   ] Finished updating board flags in 1.945 seconds
2013-06-19 04:11:03 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-19 04:11:23 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-19 04:11:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 04:11:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:11:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:11:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:11:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:11:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:11:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:11:55 [DEBUG   ] Finished updating board flags in 1.798 seconds
2013-06-19 04:12:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 04:12:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 04:12:40 [DEBUG   ] Got command RPT from MCS: ref #11131
2013-06-19 04:12:40 [DEBUG   ] summary = ERROR
2013-06-19 04:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11131  13 56462 15160673 A  ERRORERROR'
2013-06-19 04:12:40 [DEBUG   ] Got command RPT from MCS: ref #11132
2013-06-19 04:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 04:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11132  77 56462 15160674 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 04:12:43 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 04:12:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:12:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:12:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:12:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:12:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:12:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:12:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:12:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:12:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:12:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:12:55 [DEBUG   ] Finished updating board flags in 1.597 seconds
2013-06-19 04:13:03 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 04:13:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 04:13:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 04:13:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:13:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:13:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:13:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:13:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:13:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:13:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:13:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:13:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:13:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:13:55 [DEBUG   ] Finished updating board flags in 1.401 seconds
2013-06-19 04:14:03 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-19 04:14:23 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 04:14:43 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 04:14:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:14:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:14:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:14:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:14:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:14:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:14:55 [DEBUG   ] Finished updating board flags in 1.410 seconds
2013-06-19 04:15:04 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-06-19 04:15:24 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-19 04:15:44 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-19 04:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:15:54 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:15:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:15:55 [DEBUG   ] Finished updating board flags in 1.386 seconds
2013-06-19 04:16:04 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-19 04:16:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 04:16:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 04:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:16:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:16:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:16:56 [DEBUG   ] Finished updating board flags in 2.213 seconds
2013-06-19 04:17:04 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2013-06-19 04:17:24 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 04:17:40 [DEBUG   ] Got command RPT from MCS: ref #11148
2013-06-19 04:17:40 [DEBUG   ] summary = ERROR
2013-06-19 04:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11148  13 56462 15460681 A  ERRORERROR'
2013-06-19 04:17:40 [DEBUG   ] Got command RPT from MCS: ref #11149
2013-06-19 04:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 04:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11149  77 56462 15460682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 04:17:44 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 04:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:17:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:17:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:17:56 [DEBUG   ] Finished updating board flags in 2.184 seconds
2013-06-19 04:18:04 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2013-06-19 04:18:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 04:18:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 04:18:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:18:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:18:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:18:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:18:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:18:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:18:56 [DEBUG   ] Finished updating board flags in 2.013 seconds
2013-06-19 04:19:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 04:19:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 04:19:44 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 04:19:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:19:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:19:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:19:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:19:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:19:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:19:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:19:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:19:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:19:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:19:56 [DEBUG   ] Finished updating board flags in 2.024 seconds
2013-06-19 04:20:04 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-19 04:20:25 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-19 04:20:45 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-19 04:20:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:20:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:20:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:20:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:20:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:20:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-19 04:20:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:20:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:20:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:20:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:20:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:20:56 [DEBUG   ] Finished updating board flags in 1.981 seconds
2013-06-19 04:21:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 04:21:25 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-19 04:21:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 04:21:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:21:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:21:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:21:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:21:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:21:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:21:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:21:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:21:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:21:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:21:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-19 04:21:56 [DEBUG   ] Finished updating board flags in 1.807 seconds
2013-06-19 04:22:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 04:22:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 04:22:40 [DEBUG   ] Got command RPT from MCS: ref #11165
2013-06-19 04:22:40 [DEBUG   ] summary = ERROR
2013-06-19 04:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11165  13 56462 15760681 A  ERRORERROR'
2013-06-19 04:22:40 [DEBUG   ] Got command RPT from MCS: ref #11166
2013-06-19 04:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 04:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11166  77 56462 15760682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 04:22:45 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 04:22:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:22:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:22:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:22:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:22:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:22:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:22:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:22:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:22:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:22:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:22:56 [DEBUG   ] Finished updating board flags in 1.782 seconds
2013-06-19 04:23:05 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2013-06-19 04:23:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 04:23:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 04:23:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:23:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:23:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:23:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:23:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:23:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:23:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-19 04:23:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 04:23:56 [DEBUG   ] Finished updating board flags in 1.612 seconds
2013-06-19 04:24:05 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-19 04:24:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 04:24:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 04:24:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:24:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:24:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:24:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:24:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:24:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:24:56 [DEBUG   ] Finished updating board flags in 1.606 seconds
2013-06-19 04:25:05 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-19 04:25:26 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-19 04:25:46 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 04:25:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:25:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:25:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:25:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:25:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:25:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:25:56 [DEBUG   ] Finished updating board flags in 1.587 seconds
2013-06-19 04:26:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 04:26:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 04:26:46 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 04:26:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:26:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:26:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:26:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:26:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:26:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:26:56 [DEBUG   ] Finished updating board flags in 1.418 seconds
2013-06-19 04:27:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 04:27:26 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 04:27:40 [DEBUG   ] Got command RPT from MCS: ref #11182
2013-06-19 04:27:40 [DEBUG   ] summary = ERROR
2013-06-19 04:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11182  13 56462 16060677 A  ERRORERROR'
2013-06-19 04:27:40 [DEBUG   ] Got command RPT from MCS: ref #11183
2013-06-19 04:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 04:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11183  77 56462 16060678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 04:27:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 04:27:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:27:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:27:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:27:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:27:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:27:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:27:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-19 04:27:56 [DEBUG   ] Finished updating board flags in 1.406 seconds
2013-06-19 04:28:06 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 04:28:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 04:28:46 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-19 04:28:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:28:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:28:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:28:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:28:55 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:28:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:28:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:28:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:28:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:28:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:28:56 [DEBUG   ] Finished updating board flags in 1.385 seconds
2013-06-19 04:29:06 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-06-19 04:29:26 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 04:29:46 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 04:29:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:29:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:29:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:29:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:29:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:29:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:29:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:29:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:29:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:29:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:29:57 [DEBUG   ] Finished updating board flags in 2.217 seconds
2013-06-19 04:30:06 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-06-19 04:30:27 [DEBUG   ] Finished updating ant stats in 1.391 seconds
2013-06-19 04:30:47 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-19 04:30:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:30:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:30:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:30:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:30:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:30:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:30:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:30:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:30:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:30:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:30:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 04:30:57 [DEBUG   ] Finished updating board flags in 2.185 seconds
2013-06-19 04:31:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-19 04:31:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 04:31:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 04:31:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:31:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:31:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:31:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:31:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:31:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:31:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:31:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:31:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:31:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:31:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 04:31:57 [DEBUG   ] Finished updating board flags in 2.011 seconds
2013-06-19 04:32:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 04:32:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 04:32:40 [DEBUG   ] Got command RPT from MCS: ref #11199
2013-06-19 04:32:40 [DEBUG   ] summary = ERROR
2013-06-19 04:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11199  13 56462 16360681 A  ERRORERROR'
2013-06-19 04:32:40 [DEBUG   ] Got command RPT from MCS: ref #11200
2013-06-19 04:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 04:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11200  77 56462 16360682 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 04:32:47 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 04:32:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:32:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:32:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:32:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:32:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:32:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:32:57 [DEBUG   ] Finished updating board flags in 2.008 seconds
2013-06-19 04:33:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 04:33:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 04:33:47 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-19 04:33:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:33:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:33:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:33:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:33:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:33:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:33:57 [DEBUG   ] Finished updating board flags in 1.986 seconds
2013-06-19 04:34:07 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 04:34:28 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-19 04:34:48 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-19 04:34:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:34:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:34:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:34:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:34:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:34:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:34:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:34:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:34:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:34:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:34:57 [DEBUG   ] Finished updating board flags in 1.813 seconds
2013-06-19 04:35:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 04:35:28 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 04:35:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 04:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:35:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:35:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:35:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 04:35:57 [DEBUG   ] Finished updating board flags in 1.786 seconds
2013-06-19 04:36:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 04:36:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 04:36:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 04:36:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:36:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:36:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:36:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:36:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:36:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:36:57 [DEBUG   ] Finished updating board flags in 1.619 seconds
2013-06-19 04:37:08 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-19 04:37:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 04:37:40 [DEBUG   ] Got command RPT from MCS: ref #11216
2013-06-19 04:37:40 [DEBUG   ] summary = ERROR
2013-06-19 04:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11216  13 56462 16660678 A  ERRORERROR'
2013-06-19 04:37:40 [DEBUG   ] Got command RPT from MCS: ref #11217
2013-06-19 04:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 04:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11217  77 56462 16660678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 04:37:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 04:37:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:37:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:37:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:37:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:37:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:37:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:37:57 [DEBUG   ] Finished updating board flags in 1.586 seconds
2013-06-19 04:38:09 [DEBUG   ] Finished updating ant stats in 1.390 seconds
2013-06-19 04:38:29 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-19 04:38:49 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 04:38:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:38:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:38:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:38:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:38:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:38:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:38:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:38:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:38:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:38:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:38:57 [DEBUG   ] Finished updating board flags in 1.417 seconds
2013-06-19 04:39:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 04:39:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 04:39:49 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-19 04:39:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:39:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:39:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:39:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:39:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:39:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:39:58 [DEBUG   ] Finished updating board flags in 2.404 seconds
2013-06-19 04:40:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 04:40:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 04:40:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 04:40:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:40:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:40:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:40:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:40:56 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:40:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:40:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:40:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:40:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:40:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:40:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 04:40:57 [DEBUG   ] Finished updating board flags in 1.383 seconds
2013-06-19 04:41:09 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-19 04:41:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 04:41:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 04:41:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:41:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:41:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:41:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:41:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:41:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:41:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:41:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:41:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:41:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:41:58 [DEBUG   ] Finished updating board flags in 2.219 seconds
2013-06-19 04:42:09 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-19 04:42:30 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-19 04:42:40 [DEBUG   ] Got command RPT from MCS: ref #11233
2013-06-19 04:42:40 [DEBUG   ] summary = ERROR
2013-06-19 04:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11233  13 56462 16960678 A  ERRORERROR'
2013-06-19 04:42:40 [DEBUG   ] Got command RPT from MCS: ref #11234
2013-06-19 04:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 04:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11234  77 56462 16960678 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 04:42:50 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-19 04:42:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:42:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:42:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:42:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:42:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:42:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:42:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:42:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:42:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:42:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:42:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 04:42:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-19 04:42:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-19 04:42:58 [DEBUG   ] Finished updating board flags in 2.188 seconds
2013-06-19 04:43:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 04:43:30 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2013-06-19 04:43:50 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 04:43:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:43:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:43:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:43:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:43:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:43:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:43:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:43:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:43:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:43:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:43:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 04:43:58 [DEBUG   ] Finished updating board flags in 2.006 seconds
2013-06-19 04:44:10 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 04:44:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 04:44:50 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 04:44:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:44:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:44:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:44:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:44:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:44:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:44:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:44:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:44:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:44:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:44:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 04:44:58 [DEBUG   ] Finished updating board flags in 2.006 seconds
2013-06-19 04:45:10 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 04:45:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 04:45:51 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-19 04:45:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:45:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:45:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:45:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:45:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:45:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:45:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:45:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:45:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:45:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:45:58 [DEBUG   ] Finished updating board flags in 1.998 seconds
2013-06-19 04:46:11 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-19 04:46:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 04:46:51 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-19 04:46:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:46:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:46:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:46:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:46:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:46:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:46:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:46:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:46:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:46:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:46:58 [DEBUG   ] Finished updating board flags in 1.806 seconds
2013-06-19 04:47:11 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 04:47:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 04:47:40 [DEBUG   ] Got command RPT from MCS: ref #11250
2013-06-19 04:47:40 [DEBUG   ] summary = ERROR
2013-06-19 04:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11250  13 56462 17260685 A  ERRORERROR'
2013-06-19 04:47:40 [DEBUG   ] Got command RPT from MCS: ref #11251
2013-06-19 04:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 04:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11251  77 56462 17260686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 04:47:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 04:47:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:47:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:47:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:47:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:47:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:47:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:47:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:47:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:47:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:47:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:47:58 [DEBUG   ] Finished updating board flags in 1.803 seconds
2013-06-19 04:48:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 04:48:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 04:48:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 04:48:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:48:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:48:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:48:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:48:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:48:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:48:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:48:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:48:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:48:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:48:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 04:48:58 [DEBUG   ] Finished updating board flags in 1.801 seconds
2013-06-19 04:49:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 04:49:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 04:49:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 04:49:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:49:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:49:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:49:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:49:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:49:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:49:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:49:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:49:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:49:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:49:58 [DEBUG   ] Finished updating board flags in 1.803 seconds
2013-06-19 04:50:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 04:50:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 04:50:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 04:50:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:50:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:50:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:50:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:50:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:50:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:50:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:50:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:50:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:50:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:50:58 [DEBUG   ] Finished updating board flags in 1.796 seconds
2013-06-19 04:51:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 04:51:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 04:51:52 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-06-19 04:51:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:51:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:51:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:51:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:51:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:51:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:51:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:51:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:51:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:51:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:51:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 04:51:58 [DEBUG   ] Finished updating board flags in 1.610 seconds
2013-06-19 04:52:11 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-19 04:52:32 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-19 04:52:40 [DEBUG   ] Got command RPT from MCS: ref #11267
2013-06-19 04:52:40 [DEBUG   ] summary = ERROR
2013-06-19 04:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11267  13 56462 17560685 A  ERRORERROR'
2013-06-19 04:52:40 [DEBUG   ] Got command RPT from MCS: ref #11268
2013-06-19 04:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 04:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11268  77 56462 17560686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 04:52:52 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 04:52:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:52:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:52:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:52:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:52:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:52:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:52:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:52:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:52:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:52:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:52:58 [DEBUG   ] Finished updating board flags in 1.586 seconds
2013-06-19 04:53:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 04:53:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 04:53:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 04:53:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:53:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:53:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:53:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:53:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:53:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:53:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:53:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:53:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:53:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:53:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 04:53:58 [DEBUG   ] Finished updating board flags in 1.418 seconds
2013-06-19 04:54:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 04:54:32 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 04:54:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 04:54:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:54:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:54:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:54:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:54:57 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:54:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:54:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:54:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:54:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:54:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:54:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 04:54:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 04:54:58 [DEBUG   ] Finished updating board flags in 1.436 seconds
2013-06-19 04:55:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 04:55:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 04:55:52 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 04:55:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:55:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:55:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:55:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:55:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:55:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:55:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:55:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:55:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:55:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:55:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 04:55:59 [DEBUG   ] Finished updating board flags in 2.421 seconds
2013-06-19 04:56:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 04:56:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 04:56:53 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-19 04:56:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:56:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:56:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:56:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:56:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:56:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:56:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:56:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:56:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:56:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:56:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-19 04:56:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 04:56:59 [DEBUG   ] Finished updating board flags in 2.346 seconds
2013-06-19 04:57:13 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-19 04:57:33 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-19 04:57:40 [DEBUG   ] Got command RPT from MCS: ref #11284
2013-06-19 04:57:40 [DEBUG   ] summary = ERROR
2013-06-19 04:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11284  13 56462 17860689 A  ERRORERROR'
2013-06-19 04:57:40 [DEBUG   ] Got command RPT from MCS: ref #11285
2013-06-19 04:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 04:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11285  77 56462 17860690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 04:57:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 04:57:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:57:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:57:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:57:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:57:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:57:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:57:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:57:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:57:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:57:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:57:59 [DEBUG   ] Finished updating board flags in 2.196 seconds
2013-06-19 04:58:13 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-19 04:58:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 04:58:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 04:58:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:58:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:58:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:58:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:58:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:58:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:58:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:58:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:58:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:58:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:58:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 04:58:59 [DEBUG   ] Finished updating board flags in 2.011 seconds
2013-06-19 04:59:13 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 04:59:33 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 04:59:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 04:59:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 04:59:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 04:59:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 04:59:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 04:59:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 04:59:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 04:59:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 04:59:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 04:59:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 04:59:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 04:59:59 [DEBUG   ] Finished updating board flags in 2.007 seconds
2013-06-19 05:00:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 05:00:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 05:00:53 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 05:00:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 05:00:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 05:00:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 05:00:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 05:00:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 05:00:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 05:00:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 05:00:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 05:00:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 05:00:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 05:00:59 [DEBUG   ] Finished updating board flags in 1.984 seconds
2013-06-19 05:01:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 05:01:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 05:01:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 05:01:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 05:01:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 05:01:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 05:01:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 05:01:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 05:01:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 05:01:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 05:01:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 05:01:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 05:01:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 05:01:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-06-19 05:01:59 [CRITICAL] MGT underflow detected on beam(s) 1
2013-06-19 05:01:59 [DEBUG   ] Finished updating board flags in 1.810 seconds
2013-06-19 05:02:13 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-19 05:02:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 05:02:40 [DEBUG   ] Got command RPT from MCS: ref #11301
2013-06-19 05:02:40 [DEBUG   ] summary = ERROR
2013-06-19 05:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11301  13 56462 18160685 A  ERRORERROR'
2013-06-19 05:02:40 [DEBUG   ] Got command RPT from MCS: ref #11302
2013-06-19 05:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 05:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11302  77 56462 18160686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 05:02:54 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-19 05:02:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 05:02:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 05:02:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 05:02:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 05:02:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 05:02:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 05:02:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 05:02:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 05:02:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 05:02:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 05:02:59 [DEBUG   ] Finished updating board flags in 1.792 seconds
2013-06-19 05:03:14 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-19 05:03:34 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-19 05:03:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 05:03:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 05:03:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 05:03:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 05:03:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 05:03:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 05:03:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 05:03:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 05:03:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 05:03:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 05:03:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 05:03:59 [DEBUG   ] Finished updating board flags in 1.611 seconds
2013-06-19 05:04:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 05:04:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 05:04:54 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 05:04:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999803
2013-06-19 05:04:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999803
2013-06-19 05:04:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999803
2013-06-19 05:04:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999803
2013-06-19 05:04:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999803
2013-06-19 05:04:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999803
2013-06-19 05:04:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999803
2013-06-19 05:04:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999803
2013-06-19 05:04:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999803
2013-06-19 05:04:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999803
2013-06-19 05:04:59 [DEBUG   ] Finished updating board flags in 1.666 seconds
2013-06-19 05:05:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 05:05:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 05:05:54 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 196000038
2013-06-19 05:05:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000038
2013-06-19 05:05:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000038
2013-06-19 05:05:59 [DEBUG   ] Finished updating board flags in 1.541 seconds
2013-06-19 05:06:14 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-19 05:06:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 05:06:54 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-19 05:06:58 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 196000019
2013-06-19 05:06:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 196000019
2013-06-19 05:06:59 [DEBUG   ] Finished updating board flags in 1.430 seconds
2013-06-19 05:07:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 05:07:34 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-19 05:07:40 [DEBUG   ] Got command RPT from MCS: ref #11318
2013-06-19 05:07:40 [DEBUG   ] summary = ERROR
2013-06-19 05:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11318  13 56462 18460685 A  ERRORERROR'
2013-06-19 05:07:40 [DEBUG   ] Got command RPT from MCS: ref #11319
2013-06-19 05:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 05:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11319  77 56462 18460686 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 05:07:55 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-19 05:07:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-19 05:07:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-19 05:07:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-19 05:07:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-19 05:07:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-19 05:08:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 05:08:00 [DEBUG   ] Finished updating board flags in 2.391 seconds
2013-06-19 05:08:15 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 05:08:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-19 05:08:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 05:08:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-19 05:08:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-19 05:08:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-19 05:08:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-19 05:08:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-19 05:09:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-19 05:09:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-19 05:09:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-19 05:09:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-19 05:09:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-19 05:09:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-19 05:09:00 [DEBUG   ] Finished updating board flags in 2.171 seconds
2013-06-19 05:09:15 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-19 05:09:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 05:09:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 05:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-19 05:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-19 05:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-19 05:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-19 05:09:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-19 05:10:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-19 05:10:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-19 05:10:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-19 05:10:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-19 05:10:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-19 05:10:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-19 05:10:00 [DEBUG   ] Finished updating board flags in 2.014 seconds
2013-06-19 05:10:15 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 05:10:35 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 05:10:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 05:10:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-19 05:10:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-19 05:10:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-19 05:10:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-19 05:10:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-19 05:11:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-19 05:11:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-19 05:11:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-19 05:11:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-19 05:11:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-19 05:11:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 05:11:00 [DEBUG   ] Finished updating board flags in 2.015 seconds
2013-06-19 05:11:15 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 05:11:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 05:11:55 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-19 05:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-19 05:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-19 05:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-19 05:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-19 05:11:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-19 05:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-19 05:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-19 05:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-19 05:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-19 05:12:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-19 05:12:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 05:12:00 [DEBUG   ] Finished updating board flags in 2.013 seconds
2013-06-19 05:12:15 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 05:12:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 05:12:40 [DEBUG   ] Got command RPT from MCS: ref #11335
2013-06-19 05:12:40 [DEBUG   ] summary = ERROR
2013-06-19 05:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11335  13 56462 18760693 A  ERRORERROR'
2013-06-19 05:12:40 [DEBUG   ] Got command RPT from MCS: ref #11336
2013-06-19 05:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 05:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11336  77 56462 18760694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 05:12:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 05:12:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-19 05:12:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-19 05:12:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-19 05:12:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-19 05:12:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-19 05:13:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-19 05:13:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-19 05:13:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-19 05:13:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-19 05:13:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-19 05:13:00 [DEBUG   ] Finished updating board flags in 1.983 seconds
2013-06-19 05:13:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 05:13:35 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2013-06-19 05:13:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-19 05:13:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-19 05:13:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-19 05:13:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-19 05:13:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-19 05:13:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-19 05:14:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-19 05:14:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-19 05:14:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-19 05:14:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-19 05:14:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-19 05:14:00 [DEBUG   ] Finished updating board flags in 1.790 seconds
2013-06-19 05:14:16 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-19 05:14:35 [DEBUG   ] Finished updating ant stats in 0.409 seconds
2013-06-19 05:14:56 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-19 05:14:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-19 05:14:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-19 05:14:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-19 05:14:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-19 05:14:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-19 05:15:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-19 05:15:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-19 05:15:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-19 05:15:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-19 05:15:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-19 05:15:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 05:15:00 [DEBUG   ] Finished updating board flags in 1.616 seconds
2013-06-19 05:15:16 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 05:15:36 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 05:15:56 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 05:15:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-19 05:15:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-19 05:15:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-19 05:15:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-19 05:15:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-19 05:16:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-19 05:16:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-19 05:16:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-19 05:16:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-19 05:16:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-19 05:16:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 05:16:00 [DEBUG   ] Finished updating board flags in 1.592 seconds
2013-06-19 05:16:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 05:16:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 05:16:56 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 05:16:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-19 05:16:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-19 05:16:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-19 05:16:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-19 05:16:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-19 05:17:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-19 05:17:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-19 05:17:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-19 05:17:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-19 05:17:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-19 05:17:00 [DEBUG   ] Finished updating board flags in 1.413 seconds
2013-06-19 05:17:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 05:17:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 05:17:40 [DEBUG   ] Got command RPT from MCS: ref #11352
2013-06-19 05:17:40 [DEBUG   ] summary = ERROR
2013-06-19 05:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11352  13 56462 19060689 A  ERRORERROR'
2013-06-19 05:17:40 [DEBUG   ] Got command RPT from MCS: ref #11353
2013-06-19 05:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 05:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11353  77 56462 19060690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 05:17:56 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 05:17:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-19 05:17:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-19 05:17:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-19 05:17:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-19 05:17:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-19 05:18:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-19 05:18:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-19 05:18:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-19 05:18:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-19 05:18:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-19 05:18:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 05:18:00 [DEBUG   ] Finished updating board flags in 1.402 seconds
2013-06-19 05:18:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 05:18:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 05:18:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 05:18:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999705
2013-06-19 05:18:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999705
2013-06-19 05:18:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999705
2013-06-19 05:18:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999705
2013-06-19 05:18:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999705
2013-06-19 05:19:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999705
2013-06-19 05:19:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999705
2013-06-19 05:19:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999705
2013-06-19 05:19:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999705
2013-06-19 05:19:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999705
2013-06-19 05:19:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 05:19:00 [DEBUG   ] Finished updating board flags in 1.415 seconds
2013-06-19 05:19:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 05:19:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 05:19:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-19 05:19:59 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-19 05:20:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 05:20:00 [DEBUG   ] Finished updating board flags in 1.424 seconds
2013-06-19 05:20:16 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 05:20:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 05:20:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-19 05:21:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-19 05:21:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-19 05:21:01 [DEBUG   ] Finished updating board flags in 2.411 seconds
2013-06-19 05:21:16 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 05:21:37 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-19 05:21:57 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 05:22:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999509
2013-06-19 05:22:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999509
2013-06-19 05:22:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999509
2013-06-19 05:22:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999509
2013-06-19 05:22:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999509
2013-06-19 05:22:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999509
2013-06-19 05:22:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999509
2013-06-19 05:22:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999509
2013-06-19 05:22:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999509
2013-06-19 05:22:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999509
2013-06-19 05:22:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-19 05:22:01 [DEBUG   ] Finished updating board flags in 2.360 seconds
2013-06-19 05:22:17 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 05:22:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 05:22:40 [DEBUG   ] Got command RPT from MCS: ref #11369
2013-06-19 05:22:40 [DEBUG   ] summary = ERROR
2013-06-19 05:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11369  13 56462 19360693 A  ERRORERROR'
2013-06-19 05:22:40 [DEBUG   ] Got command RPT from MCS: ref #11370
2013-06-19 05:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 05:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11370  77 56462 19360694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 05:22:57 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-19 05:23:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-19 05:23:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-19 05:23:01 [DEBUG   ] Finished updating board flags in 2.226 seconds
2013-06-19 05:23:17 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 05:23:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 05:23:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-19 05:24:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-19 05:24:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-19 05:24:01 [DEBUG   ] Finished updating board flags in 2.181 seconds
2013-06-19 05:24:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 05:24:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 05:24:57 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 05:25:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-19 05:25:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-19 05:25:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-19 05:25:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-19 05:25:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-19 05:25:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-19 05:25:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-19 05:25:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-19 05:25:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-19 05:25:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-19 05:25:01 [DEBUG   ] Finished updating board flags in 2.061 seconds
2013-06-19 05:25:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 05:25:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 05:25:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 05:26:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-19 05:26:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-19 05:26:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-19 05:26:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-19 05:26:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-19 05:26:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-19 05:26:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-19 05:26:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-19 05:26:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-19 05:26:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-19 05:26:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 05:26:01 [DEBUG   ] Finished updating board flags in 2.009 seconds
2013-06-19 05:26:17 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 05:26:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 05:26:58 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-19 05:27:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-19 05:27:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-19 05:27:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-19 05:27:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-19 05:27:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-19 05:27:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-19 05:27:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-19 05:27:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-19 05:27:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-19 05:27:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-19 05:27:01 [DEBUG   ] Finished updating board flags in 1.930 seconds
2013-06-19 05:27:17 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 05:27:37 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2013-06-19 05:27:40 [DEBUG   ] Got command RPT from MCS: ref #11386
2013-06-19 05:27:40 [DEBUG   ] summary = ERROR
2013-06-19 05:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11386  13 56462 19660697 A  ERRORERROR'
2013-06-19 05:27:40 [DEBUG   ] Got command RPT from MCS: ref #11387
2013-06-19 05:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 05:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11387  77 56462 19660698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 05:27:58 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 05:28:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-19 05:28:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-19 05:28:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-19 05:28:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-19 05:28:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-19 05:28:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-19 05:28:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-19 05:28:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-19 05:28:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-19 05:28:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-19 05:28:01 [DEBUG   ] Finished updating board flags in 1.805 seconds
2013-06-19 05:28:18 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 05:28:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-19 05:28:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 05:29:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-19 05:29:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-19 05:29:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-19 05:29:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-19 05:29:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-19 05:29:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-19 05:29:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-19 05:29:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-19 05:29:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-19 05:29:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-19 05:29:01 [DEBUG   ] Finished updating board flags in 1.796 seconds
2013-06-19 05:29:18 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 05:29:38 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 05:29:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 05:30:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-19 05:30:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-19 05:30:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-19 05:30:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-19 05:30:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-19 05:30:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-19 05:30:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-19 05:30:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-19 05:30:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-19 05:30:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-19 05:30:01 [DEBUG   ] Finished updating board flags in 1.604 seconds
2013-06-19 05:30:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 05:30:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 05:30:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 05:31:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-19 05:31:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-19 05:31:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-19 05:31:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-19 05:31:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-19 05:31:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-19 05:31:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-19 05:31:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-19 05:31:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-19 05:31:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-19 05:31:01 [DEBUG   ] Finished updating board flags in 1.613 seconds
2013-06-19 05:31:18 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2013-06-19 05:31:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 05:31:59 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-19 05:32:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-19 05:32:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-19 05:32:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-19 05:32:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-19 05:32:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-19 05:32:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-19 05:32:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-19 05:32:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-19 05:32:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-19 05:32:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-19 05:32:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 05:32:01 [DEBUG   ] Finished updating board flags in 1.585 seconds
2013-06-19 05:32:19 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-19 05:32:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-19 05:32:40 [DEBUG   ] Got command RPT from MCS: ref #11403
2013-06-19 05:32:40 [DEBUG   ] summary = ERROR
2013-06-19 05:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11403  13 56462 19960690 A  ERRORERROR'
2013-06-19 05:32:40 [DEBUG   ] Got command RPT from MCS: ref #11404
2013-06-19 05:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 05:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11404  77 56462 19960690 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 05:32:59 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-19 05:33:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-19 05:33:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-19 05:33:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-19 05:33:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-19 05:33:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-19 05:33:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-19 05:33:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-19 05:33:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-19 05:33:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-19 05:33:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-19 05:33:01 [DEBUG   ] Finished updating board flags in 1.419 seconds
2013-06-19 05:33:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 05:33:39 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-19 05:33:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 05:34:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-19 05:34:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-19 05:34:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-19 05:34:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-19 05:34:00 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-19 05:34:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-19 05:34:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-19 05:34:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-19 05:34:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-19 05:34:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-19 05:34:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 05:34:01 [DEBUG   ] Finished updating board flags in 1.385 seconds
2013-06-19 05:34:19 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 05:34:39 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2013-06-19 05:34:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 05:35:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-19 05:35:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-19 05:35:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-19 05:35:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-19 05:35:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-19 05:35:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-19 05:35:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-19 05:35:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-19 05:35:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-19 05:35:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-19 05:35:02 [DEBUG   ] Finished updating board flags in 2.215 seconds
2013-06-19 05:35:19 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 05:35:39 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 05:35:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 05:36:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-19 05:36:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-19 05:36:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-19 05:36:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-19 05:36:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-19 05:36:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-19 05:36:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-19 05:36:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-19 05:36:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-19 05:36:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-19 05:36:02 [DEBUG   ] Finished updating board flags in 2.217 seconds
2013-06-19 05:36:19 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 05:36:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-19 05:37:00 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-19 05:37:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999411
2013-06-19 05:37:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999411
2013-06-19 05:37:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999411
2013-06-19 05:37:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999411
2013-06-19 05:37:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999411
2013-06-19 05:37:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999411
2013-06-19 05:37:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999411
2013-06-19 05:37:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999411
2013-06-19 05:37:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999411
2013-06-19 05:37:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999411
2013-06-19 05:37:02 [DEBUG   ] Finished updating board flags in 2.213 seconds
2013-06-19 05:37:20 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-19 05:37:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 05:37:40 [DEBUG   ] Got command RPT from MCS: ref #11420
2013-06-19 05:37:40 [DEBUG   ] summary = ERROR
2013-06-19 05:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11420  13 56462 20260697 A  ERRORERROR'
2013-06-19 05:37:40 [DEBUG   ] Got command RPT from MCS: ref #11421
2013-06-19 05:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 05:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11421  77 56462 20260698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 05:38:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999313
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999313
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999313
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999313
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999313
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-19 05:38:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999313
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999313
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999313
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999313
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999313
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-19 05:38:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-19 05:38:02 [DEBUG   ] Finished updating board flags in 2.173 seconds
2013-06-19 05:38:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 05:38:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 05:39:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-19 05:39:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-19 05:39:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-19 05:39:02 [DEBUG   ] Finished updating board flags in 2.013 seconds
2013-06-19 05:39:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 05:39:40 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 05:40:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 05:40:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-19 05:40:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-19 05:40:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-19 05:40:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-19 05:40:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-19 05:40:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-19 05:40:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-19 05:40:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-19 05:40:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-19 05:40:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-19 05:40:02 [DEBUG   ] Finished updating board flags in 1.989 seconds
2013-06-19 05:40:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 05:40:40 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 05:41:00 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 05:41:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-19 05:41:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-19 05:41:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-19 05:41:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-19 05:41:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-19 05:41:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-19 05:41:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-19 05:41:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-19 05:41:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-19 05:41:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-19 05:41:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 05:41:02 [DEBUG   ] Finished updating board flags in 1.798 seconds
2013-06-19 05:41:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 05:41:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 05:42:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 05:42:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-19 05:42:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-19 05:42:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-19 05:42:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-19 05:42:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-19 05:42:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-19 05:42:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-19 05:42:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-19 05:42:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-19 05:42:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-19 05:42:02 [DEBUG   ] Finished updating board flags in 1.628 seconds
2013-06-19 05:42:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 05:42:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-19 05:42:40 [DEBUG   ] Got command RPT from MCS: ref #11437
2013-06-19 05:42:40 [DEBUG   ] summary = ERROR
2013-06-19 05:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11437  13 56462 20560693 A  ERRORERROR'
2013-06-19 05:42:40 [DEBUG   ] Got command RPT from MCS: ref #11438
2013-06-19 05:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 05:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11438  77 56462 20560694 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 05:43:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999215
2013-06-19 05:43:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999215
2013-06-19 05:43:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999215
2013-06-19 05:43:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999215
2013-06-19 05:43:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999215
2013-06-19 05:43:01 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-19 05:43:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999215
2013-06-19 05:43:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999215
2013-06-19 05:43:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999215
2013-06-19 05:43:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999215
2013-06-19 05:43:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999215
2013-06-19 05:43:02 [DEBUG   ] Finished updating board flags in 1.562 seconds
2013-06-19 05:43:21 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-19 05:43:41 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-19 05:44:01 [DEBUG   ] Finished updating ant stats in 1.251 seconds
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-19 05:44:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-19 05:44:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-19 05:44:02 [DEBUG   ] Finished updating board flags in 1.429 seconds
2013-06-19 05:44:21 [DEBUG   ] Finished updating ant stats in 1.157 seconds
2013-06-19 05:44:41 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-19 05:45:01 [DEBUG   ] Finished updating ant stats in 0.832 seconds
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-19 05:45:01 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-19 05:45:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-19 05:45:02 [DEBUG   ] Finished updating board flags in 1.388 seconds
2013-06-19 05:45:21 [DEBUG   ] Finished updating ant stats in 0.770 seconds
2013-06-19 05:45:41 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 05:46:01 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 05:46:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-19 05:46:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-19 05:46:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-19 05:46:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-19 05:46:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-19 05:46:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-19 05:46:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-19 05:46:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-19 05:46:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-19 05:46:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-19 05:46:03 [DEBUG   ] Finished updating board flags in 2.215 seconds
2013-06-19 05:46:22 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-19 05:46:42 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 05:47:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-19 05:47:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-19 05:47:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-19 05:47:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-19 05:47:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-19 05:47:02 [DEBUG   ] Finished updating ant stats in 1.249 seconds
2013-06-19 05:47:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-19 05:47:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-19 05:47:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-19 05:47:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-19 05:47:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-19 05:47:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 05:47:03 [DEBUG   ] Finished updating board flags in 2.193 seconds
2013-06-19 05:47:22 [DEBUG   ] Finished updating ant stats in 1.151 seconds
2013-06-19 05:47:40 [DEBUG   ] Got command RPT from MCS: ref #11454
2013-06-19 05:47:40 [DEBUG   ] summary = ERROR
2013-06-19 05:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11454  13 56462 20860701 A  ERRORERROR'
2013-06-19 05:47:40 [DEBUG   ] Got command RPT from MCS: ref #11455
2013-06-19 05:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 05:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11455  77 56462 20860702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 05:47:42 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 05:48:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-19 05:48:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-19 05:48:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-19 05:48:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-19 05:48:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-19 05:48:02 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2013-06-19 05:48:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-19 05:48:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-19 05:48:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-19 05:48:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-19 05:48:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-19 05:48:03 [DEBUG   ] Finished updating board flags in 2.044 seconds
2013-06-19 05:48:22 [DEBUG   ] Finished updating ant stats in 0.954 seconds
2013-06-19 05:48:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 05:49:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-19 05:49:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-19 05:49:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-19 05:49:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-19 05:49:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-19 05:49:02 [DEBUG   ] Finished updating ant stats in 0.850 seconds
2013-06-19 05:49:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-19 05:49:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-19 05:49:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-19 05:49:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-19 05:49:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-19 05:49:03 [DEBUG   ] Finished updating board flags in 1.958 seconds
2013-06-19 05:49:22 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2013-06-19 05:49:42 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-19 05:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-19 05:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-19 05:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-19 05:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-19 05:50:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-19 05:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-19 05:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-19 05:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-19 05:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-19 05:50:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-19 05:50:03 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-19 05:50:03 [DEBUG   ] Finished updating board flags in 1.838 seconds
2013-06-19 05:50:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 05:50:43 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2013-06-19 05:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-19 05:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-19 05:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-19 05:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-19 05:51:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-19 05:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-19 05:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-19 05:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-19 05:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-19 05:51:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-19 05:51:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 05:51:03 [DEBUG   ] Finished updating ant stats in 1.046 seconds
2013-06-19 05:51:03 [DEBUG   ] Finished updating board flags in 1.825 seconds
2013-06-19 05:51:23 [DEBUG   ] Finished updating ant stats in 0.960 seconds
2013-06-19 05:51:43 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 05:52:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-19 05:52:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-19 05:52:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-19 05:52:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-19 05:52:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-19 05:52:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-19 05:52:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-19 05:52:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-19 05:52:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-19 05:52:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-19 05:52:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 05:52:03 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2013-06-19 05:52:03 [DEBUG   ] Finished updating board flags in 1.786 seconds
2013-06-19 05:52:23 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2013-06-19 05:52:40 [DEBUG   ] Got command RPT from MCS: ref #11471
2013-06-19 05:52:40 [DEBUG   ] summary = ERROR
2013-06-19 05:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11471  13 56462 21160697 A  ERRORERROR'
2013-06-19 05:52:40 [DEBUG   ] Got command RPT from MCS: ref #11472
2013-06-19 05:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 05:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11472  77 56462 21160698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 05:52:44 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-19 05:53:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-19 05:53:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-19 05:53:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-19 05:53:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-19 05:53:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-19 05:53:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-19 05:53:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-19 05:53:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-19 05:53:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-19 05:53:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-19 05:53:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-19 05:53:03 [DEBUG   ] Finished updating board flags in 1.612 seconds
2013-06-19 05:53:04 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-19 05:53:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 05:53:44 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 05:54:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-19 05:54:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-19 05:54:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-19 05:54:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-19 05:54:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-19 05:54:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-19 05:54:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-19 05:54:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-19 05:54:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-19 05:54:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-19 05:54:03 [DEBUG   ] Finished updating board flags in 1.606 seconds
2013-06-19 05:54:04 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 05:54:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 05:54:44 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 05:55:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-19 05:55:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-19 05:55:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-19 05:55:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-19 05:55:02 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-19 05:55:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-19 05:55:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-19 05:55:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-19 05:55:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-19 05:55:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-19 05:55:03 [DEBUG   ] Finished updating board flags in 1.594 seconds
2013-06-19 05:55:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 05:55:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 05:55:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 05:56:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-19 05:56:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-19 05:56:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-19 05:56:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-19 05:56:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-19 05:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-19 05:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-19 05:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-19 05:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-19 05:56:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-19 05:56:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 05:56:04 [DEBUG   ] Finished updating ant stats in 0.644 seconds
2013-06-19 05:56:04 [DEBUG   ] Finished updating board flags in 2.423 seconds
2013-06-19 05:56:24 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2013-06-19 05:56:45 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-19 05:57:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-19 05:57:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-19 05:57:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-19 05:57:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-19 05:57:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-19 05:57:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-19 05:57:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-19 05:57:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-19 05:57:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-19 05:57:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-19 05:57:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 05:57:04 [DEBUG   ] Finished updating board flags in 2.363 seconds
2013-06-19 05:57:05 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-19 05:57:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 05:57:40 [DEBUG   ] Got command RPT from MCS: ref #11488
2013-06-19 05:57:40 [DEBUG   ] summary = ERROR
2013-06-19 05:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11488  13 56462 21460701 A  ERRORERROR'
2013-06-19 05:57:40 [DEBUG   ] Got command RPT from MCS: ref #11489
2013-06-19 05:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 05:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11489  77 56462 21460702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 05:57:45 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 05:58:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-19 05:58:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-19 05:58:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-19 05:58:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-19 05:58:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-19 05:58:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-19 05:58:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-19 05:58:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-19 05:58:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-19 05:58:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-19 05:58:04 [DEBUG   ] Finished updating board flags in 2.224 seconds
2013-06-19 05:58:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 05:58:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 05:58:45 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 05:59:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-19 05:59:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-19 05:59:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-19 05:59:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-19 05:59:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-19 05:59:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-19 05:59:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-19 05:59:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-19 05:59:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-19 05:59:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-19 05:59:04 [DEBUG   ] Finished updating board flags in 2.201 seconds
2013-06-19 05:59:05 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 05:59:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 05:59:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 06:00:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-19 06:00:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-19 06:00:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-19 06:00:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-19 06:00:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-19 06:00:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-19 06:00:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-19 06:00:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-19 06:00:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-19 06:00:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-19 06:00:04 [DEBUG   ] Finished updating board flags in 2.197 seconds
2013-06-19 06:00:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 06:00:25 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2013-06-19 06:00:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 06:01:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-19 06:01:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-19 06:01:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-19 06:01:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-19 06:01:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-19 06:01:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-19 06:01:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-19 06:01:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-19 06:01:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-19 06:01:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-19 06:01:04 [DEBUG   ] Finished updating board flags in 1.983 seconds
2013-06-19 06:01:05 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-19 06:01:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 06:01:45 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 06:02:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-19 06:02:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-19 06:02:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-19 06:02:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-19 06:02:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-19 06:02:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-19 06:02:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-19 06:02:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-19 06:02:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-19 06:02:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-19 06:02:04 [DEBUG   ] Finished updating board flags in 1.823 seconds
2013-06-19 06:02:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-19 06:02:25 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 06:02:40 [DEBUG   ] Got command RPT from MCS: ref #11505
2013-06-19 06:02:40 [DEBUG   ] summary = ERROR
2013-06-19 06:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11505  13 56462 21760705 A  ERRORERROR'
2013-06-19 06:02:40 [DEBUG   ] Got command RPT from MCS: ref #11506
2013-06-19 06:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 06:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11506  77 56462 21760706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 06:02:46 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-19 06:03:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-19 06:03:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-19 06:03:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-19 06:03:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-19 06:03:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-19 06:03:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-19 06:03:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-19 06:03:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-19 06:03:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-19 06:03:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-19 06:03:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 06:03:04 [DEBUG   ] Finished updating board flags in 1.814 seconds
2013-06-19 06:03:06 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-19 06:03:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 06:03:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 06:04:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195999117
2013-06-19 06:04:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195999117
2013-06-19 06:04:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195999117
2013-06-19 06:04:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195999117
2013-06-19 06:04:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195999117
2013-06-19 06:04:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195999117
2013-06-19 06:04:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195999117
2013-06-19 06:04:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195999117
2013-06-19 06:04:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195999117
2013-06-19 06:04:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195999117
2013-06-19 06:04:04 [DEBUG   ] Finished updating board flags in 1.731 seconds
2013-06-19 06:04:06 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-19 06:04:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 06:04:46 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998921
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998921
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998921
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998921
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998921
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-19 06:05:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998921
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998921
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998921
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998921
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998921
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-19 06:05:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-19 06:05:04 [DEBUG   ] Finished updating board flags in 1.636 seconds
2013-06-19 06:05:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 06:05:26 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-19 06:05:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998627
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998627
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998627
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998627
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998627
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-19 06:06:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998627
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998627
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998627
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998627
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998627
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-19 06:06:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-19 06:06:04 [DEBUG   ] Finished updating board flags in 1.584 seconds
2013-06-19 06:06:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 06:06:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 06:06:46 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998431
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998431
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998431
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998431
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998431
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-19 06:07:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998431
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998431
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998431
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998431
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998431
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-19 06:07:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-19 06:07:04 [DEBUG   ] Finished updating board flags in 1.417 seconds
2013-06-19 06:07:07 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-19 06:07:27 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-19 06:07:40 [DEBUG   ] Got command RPT from MCS: ref #11522
2013-06-19 06:07:40 [DEBUG   ] summary = ERROR
2013-06-19 06:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11522  13 56462 22060705 A  ERRORERROR'
2013-06-19 06:07:40 [DEBUG   ] Got command RPT from MCS: ref #11523
2013-06-19 06:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 06:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11523  77 56462 22060706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 06:07:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998333
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998333
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998333
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998333
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998333
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-19 06:08:03 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998333
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998333
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998333
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998333
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998333
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-19 06:08:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-19 06:08:04 [DEBUG   ] Finished updating board flags in 1.406 seconds
2013-06-19 06:08:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 06:08:27 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-19 06:08:47 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 06:09:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998333
2013-06-19 06:09:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998333
2013-06-19 06:09:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998333
2013-06-19 06:09:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998333
2013-06-19 06:09:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998333
2013-06-19 06:09:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998333
2013-06-19 06:09:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998333
2013-06-19 06:09:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998333
2013-06-19 06:09:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998333
2013-06-19 06:09:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998333
2013-06-19 06:09:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 06:09:05 [DEBUG   ] Finished updating board flags in 2.440 seconds
2013-06-19 06:09:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 06:09:28 [DEBUG   ] Finished updating ant stats in 2.004 seconds
2013-06-19 06:09:47 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 06:10:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998333
2013-06-19 06:10:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998333
2013-06-19 06:10:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998333
2013-06-19 06:10:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998333
2013-06-19 06:10:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998333
2013-06-19 06:10:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998333
2013-06-19 06:10:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998333
2013-06-19 06:10:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998333
2013-06-19 06:10:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998333
2013-06-19 06:10:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998333
2013-06-19 06:10:05 [DEBUG   ] Finished updating board flags in 2.332 seconds
2013-06-19 06:10:07 [DEBUG   ] Finished updating ant stats in 0.991 seconds
2013-06-19 06:10:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 06:10:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 06:11:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998333
2013-06-19 06:11:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998333
2013-06-19 06:11:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998333
2013-06-19 06:11:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998333
2013-06-19 06:11:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998333
2013-06-19 06:11:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998333
2013-06-19 06:11:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998333
2013-06-19 06:11:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998333
2013-06-19 06:11:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998333
2013-06-19 06:11:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998333
2013-06-19 06:11:05 [DEBUG   ] Finished updating board flags in 2.223 seconds
2013-06-19 06:11:07 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-19 06:11:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 06:11:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 06:12:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998333
2013-06-19 06:12:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998333
2013-06-19 06:12:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998333
2013-06-19 06:12:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998333
2013-06-19 06:12:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998333
2013-06-19 06:12:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998333
2013-06-19 06:12:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998333
2013-06-19 06:12:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998333
2013-06-19 06:12:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998333
2013-06-19 06:12:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998333
2013-06-19 06:12:05 [DEBUG   ] Finished updating board flags in 2.183 seconds
2013-06-19 06:12:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 06:12:27 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-19 06:12:40 [DEBUG   ] Got command RPT from MCS: ref #11539
2013-06-19 06:12:40 [DEBUG   ] summary = ERROR
2013-06-19 06:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11539  13 56462 22360697 A  ERRORERROR'
2013-06-19 06:12:40 [DEBUG   ] Got command RPT from MCS: ref #11540
2013-06-19 06:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 06:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11540  77 56462 22360698 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 06:12:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998137
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998137
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998137
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998137
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998137
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-19 06:13:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998137
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998137
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998137
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998137
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998137
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-19 06:13:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-19 06:13:05 [DEBUG   ] Finished updating board flags in 2.032 seconds
2013-06-19 06:13:08 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-19 06:13:28 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 06:13:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998137
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998137
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998137
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998137
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998137
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-19 06:14:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998137
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998137
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998137
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998137
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998137
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-19 06:14:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 06:14:05 [DEBUG   ] Finished updating board flags in 1.980 seconds
2013-06-19 06:14:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 06:14:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 06:14:48 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 06:15:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998137
2013-06-19 06:15:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998137
2013-06-19 06:15:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998137
2013-06-19 06:15:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998137
2013-06-19 06:15:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998137
2013-06-19 06:15:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998137
2013-06-19 06:15:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998137
2013-06-19 06:15:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998137
2013-06-19 06:15:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998137
2013-06-19 06:15:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998137
2013-06-19 06:15:05 [DEBUG   ] Finished updating board flags in 1.809 seconds
2013-06-19 06:15:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 06:15:28 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-19 06:15:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 06:16:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998137
2013-06-19 06:16:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998137
2013-06-19 06:16:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998137
2013-06-19 06:16:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998137
2013-06-19 06:16:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998137
2013-06-19 06:16:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998137
2013-06-19 06:16:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998137
2013-06-19 06:16:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998137
2013-06-19 06:16:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998137
2013-06-19 06:16:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998137
2013-06-19 06:16:05 [DEBUG   ] Finished updating board flags in 1.778 seconds
2013-06-19 06:16:08 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 06:16:28 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 06:16:49 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-19 06:17:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998137
2013-06-19 06:17:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998137
2013-06-19 06:17:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998137
2013-06-19 06:17:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998137
2013-06-19 06:17:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998137
2013-06-19 06:17:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998137
2013-06-19 06:17:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998137
2013-06-19 06:17:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998137
2013-06-19 06:17:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998137
2013-06-19 06:17:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998137
2013-06-19 06:17:05 [DEBUG   ] Finished updating board flags in 1.612 seconds
2013-06-19 06:17:09 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2013-06-19 06:17:28 [DEBUG   ] Finished updating ant stats in 0.408 seconds
2013-06-19 06:17:40 [DEBUG   ] Got command RPT from MCS: ref #11556
2013-06-19 06:17:40 [DEBUG   ] summary = ERROR
2013-06-19 06:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11556  13 56462 22660701 A  ERRORERROR'
2013-06-19 06:17:40 [DEBUG   ] Got command RPT from MCS: ref #11557
2013-06-19 06:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 06:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11557  77 56462 22660702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 06:17:48 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2013-06-19 06:18:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998137
2013-06-19 06:18:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998137
2013-06-19 06:18:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998137
2013-06-19 06:18:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998137
2013-06-19 06:18:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998137
2013-06-19 06:18:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998137
2013-06-19 06:18:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998137
2013-06-19 06:18:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998137
2013-06-19 06:18:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998137
2013-06-19 06:18:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998137
2013-06-19 06:18:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-19 06:18:05 [DEBUG   ] Finished updating board flags in 1.639 seconds
2013-06-19 06:18:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 06:18:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 06:18:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 06:19:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998137
2013-06-19 06:19:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998137
2013-06-19 06:19:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998137
2013-06-19 06:19:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998137
2013-06-19 06:19:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998137
2013-06-19 06:19:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998137
2013-06-19 06:19:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998137
2013-06-19 06:19:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998137
2013-06-19 06:19:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998137
2013-06-19 06:19:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998137
2013-06-19 06:19:05 [DEBUG   ] Finished updating board flags in 1.564 seconds
2013-06-19 06:19:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 06:19:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 06:19:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 06:20:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998137
2013-06-19 06:20:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998137
2013-06-19 06:20:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998137
2013-06-19 06:20:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998137
2013-06-19 06:20:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998137
2013-06-19 06:20:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998137
2013-06-19 06:20:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998137
2013-06-19 06:20:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998137
2013-06-19 06:20:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998137
2013-06-19 06:20:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998137
2013-06-19 06:20:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 06:20:05 [DEBUG   ] Finished updating board flags in 1.430 seconds
2013-06-19 06:20:09 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 06:20:29 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 06:20:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 06:21:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998137
2013-06-19 06:21:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998137
2013-06-19 06:21:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998137
2013-06-19 06:21:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998137
2013-06-19 06:21:04 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998137
2013-06-19 06:21:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998137
2013-06-19 06:21:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998137
2013-06-19 06:21:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998137
2013-06-19 06:21:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998137
2013-06-19 06:21:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998137
2013-06-19 06:21:05 [DEBUG   ] Finished updating board flags in 1.375 seconds
2013-06-19 06:21:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 06:21:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 06:21:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 06:22:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195998137
2013-06-19 06:22:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195998137
2013-06-19 06:22:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195998137
2013-06-19 06:22:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195998137
2013-06-19 06:22:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195998137
2013-06-19 06:22:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195998137
2013-06-19 06:22:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195998137
2013-06-19 06:22:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195998137
2013-06-19 06:22:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195998137
2013-06-19 06:22:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195998137
2013-06-19 06:22:06 [DEBUG   ] Finished updating board flags in 2.226 seconds
2013-06-19 06:22:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 06:22:29 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 06:22:40 [DEBUG   ] Got command RPT from MCS: ref #11573
2013-06-19 06:22:40 [DEBUG   ] summary = ERROR
2013-06-19 06:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11573  13 56462 22960705 A  ERRORERROR'
2013-06-19 06:22:40 [DEBUG   ] Got command RPT from MCS: ref #11574
2013-06-19 06:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 06:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11574  77 56462 22960706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 06:22:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997941
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997941
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997941
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997941
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997941
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-19 06:23:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997941
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997941
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997941
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997941
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997941
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-19 06:23:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 06:23:06 [DEBUG   ] Finished updating board flags in 2.193 seconds
2013-06-19 06:23:10 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-19 06:23:30 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 06:23:50 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997941
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997941
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997941
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997941
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997941
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-19 06:24:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997941
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997941
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997941
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997941
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997941
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-19 06:24:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-19 06:24:06 [DEBUG   ] Finished updating board flags in 2.025 seconds
2013-06-19 06:24:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 06:24:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 06:24:50 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 06:25:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997941
2013-06-19 06:25:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997941
2013-06-19 06:25:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997941
2013-06-19 06:25:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997941
2013-06-19 06:25:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997941
2013-06-19 06:25:11 [DEBUG   ] Finished updating ant stats in 2.001 seconds
2013-06-19 06:25:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997941
2013-06-19 06:25:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997941
2013-06-19 06:25:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997941
2013-06-19 06:25:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997941
2013-06-19 06:25:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997941
2013-06-19 06:25:31 [DEBUG   ] Finished updating ant stats in 2.007 seconds
2013-06-19 06:25:33 [DEBUG   ] Finished updating board flags in 29.110 seconds
2013-06-19 06:25:50 [DEBUG   ] Finished updating ant stats in 1.355 seconds
2013-06-19 06:26:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997941
2013-06-19 06:26:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997941
2013-06-19 06:26:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997941
2013-06-19 06:26:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997941
2013-06-19 06:26:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997941
2013-06-19 06:26:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997941
2013-06-19 06:26:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997941
2013-06-19 06:26:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997941
2013-06-19 06:26:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997941
2013-06-19 06:26:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997941
2013-06-19 06:26:06 [DEBUG   ] Finished updating board flags in 1.856 seconds
2013-06-19 06:26:10 [DEBUG   ] Finished updating ant stats in 0.844 seconds
2013-06-19 06:26:30 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-19 06:26:50 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 06:27:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997941
2013-06-19 06:27:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997941
2013-06-19 06:27:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997941
2013-06-19 06:27:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997941
2013-06-19 06:27:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997941
2013-06-19 06:27:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997941
2013-06-19 06:27:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997941
2013-06-19 06:27:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997941
2013-06-19 06:27:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997941
2013-06-19 06:27:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997941
2013-06-19 06:27:06 [DEBUG   ] Finished updating board flags in 1.831 seconds
2013-06-19 06:27:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 06:27:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 06:27:40 [DEBUG   ] Got command RPT from MCS: ref #11590
2013-06-19 06:27:40 [DEBUG   ] summary = ERROR
2013-06-19 06:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11590  13 56462 23260709 A  ERRORERROR'
2013-06-19 06:27:40 [DEBUG   ] Got command RPT from MCS: ref #11591
2013-06-19 06:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 06:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11591  77 56462 23260710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 06:27:50 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-19 06:28:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997941
2013-06-19 06:28:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997941
2013-06-19 06:28:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997941
2013-06-19 06:28:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997941
2013-06-19 06:28:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997941
2013-06-19 06:28:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997941
2013-06-19 06:28:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997941
2013-06-19 06:28:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997941
2013-06-19 06:28:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997941
2013-06-19 06:28:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997941
2013-06-19 06:28:06 [DEBUG   ] Finished updating board flags in 1.811 seconds
2013-06-19 06:28:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 06:28:31 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-19 06:28:51 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-19 06:29:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997941
2013-06-19 06:29:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997941
2013-06-19 06:29:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997941
2013-06-19 06:29:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997941
2013-06-19 06:29:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997941
2013-06-19 06:29:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997941
2013-06-19 06:29:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997941
2013-06-19 06:29:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997941
2013-06-19 06:29:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997941
2013-06-19 06:29:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997941
2013-06-19 06:29:06 [DEBUG   ] Finished updating board flags in 1.815 seconds
2013-06-19 06:29:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 06:29:31 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 06:29:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 06:30:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997941
2013-06-19 06:30:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997941
2013-06-19 06:30:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997941
2013-06-19 06:30:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997941
2013-06-19 06:30:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997941
2013-06-19 06:30:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997941
2013-06-19 06:30:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997941
2013-06-19 06:30:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997941
2013-06-19 06:30:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997941
2013-06-19 06:30:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997941
2013-06-19 06:30:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 06:30:06 [DEBUG   ] Finished updating board flags in 1.760 seconds
2013-06-19 06:30:11 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-19 06:30:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 06:30:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 06:31:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997941
2013-06-19 06:31:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997941
2013-06-19 06:31:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997941
2013-06-19 06:31:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997941
2013-06-19 06:31:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997941
2013-06-19 06:31:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997941
2013-06-19 06:31:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997941
2013-06-19 06:31:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997941
2013-06-19 06:31:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997941
2013-06-19 06:31:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997941
2013-06-19 06:31:06 [DEBUG   ] Finished updating board flags in 1.613 seconds
2013-06-19 06:31:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 06:31:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 06:31:51 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 06:32:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997941
2013-06-19 06:32:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997941
2013-06-19 06:32:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997941
2013-06-19 06:32:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997941
2013-06-19 06:32:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997941
2013-06-19 06:32:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997941
2013-06-19 06:32:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997941
2013-06-19 06:32:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997941
2013-06-19 06:32:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997941
2013-06-19 06:32:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997941
2013-06-19 06:32:06 [DEBUG   ] Finished updating board flags in 1.596 seconds
2013-06-19 06:32:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 06:32:31 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 06:32:40 [DEBUG   ] Got command RPT from MCS: ref #11607
2013-06-19 06:32:40 [DEBUG   ] summary = ERROR
2013-06-19 06:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11607  13 56462 23560701 A  ERRORERROR'
2013-06-19 06:32:40 [DEBUG   ] Got command RPT from MCS: ref #11608
2013-06-19 06:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 06:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11608  77 56462 23560702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 06:32:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-19 06:33:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997941
2013-06-19 06:33:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997941
2013-06-19 06:33:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997941
2013-06-19 06:33:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997941
2013-06-19 06:33:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997941
2013-06-19 06:33:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997941
2013-06-19 06:33:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997941
2013-06-19 06:33:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997941
2013-06-19 06:33:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997941
2013-06-19 06:33:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997941
2013-06-19 06:33:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 06:33:06 [DEBUG   ] Finished updating board flags in 1.403 seconds
2013-06-19 06:33:11 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 06:33:32 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-19 06:33:52 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-19 06:34:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997941
2013-06-19 06:34:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997941
2013-06-19 06:34:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997941
2013-06-19 06:34:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997941
2013-06-19 06:34:05 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997941
2013-06-19 06:34:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997941
2013-06-19 06:34:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997941
2013-06-19 06:34:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997941
2013-06-19 06:34:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997941
2013-06-19 06:34:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997941
2013-06-19 06:34:06 [DEBUG   ] Finished updating board flags in 1.395 seconds
2013-06-19 06:34:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-19 06:34:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 06:34:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 06:35:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997941
2013-06-19 06:35:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997941
2013-06-19 06:35:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997941
2013-06-19 06:35:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997941
2013-06-19 06:35:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997941
2013-06-19 06:35:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997941
2013-06-19 06:35:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997941
2013-06-19 06:35:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997941
2013-06-19 06:35:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997941
2013-06-19 06:35:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997941
2013-06-19 06:35:07 [DEBUG   ] Finished updating board flags in 2.212 seconds
2013-06-19 06:35:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 06:35:32 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 06:35:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 06:36:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997941
2013-06-19 06:36:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997941
2013-06-19 06:36:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997941
2013-06-19 06:36:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997941
2013-06-19 06:36:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997941
2013-06-19 06:36:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997941
2013-06-19 06:36:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997941
2013-06-19 06:36:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997941
2013-06-19 06:36:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997941
2013-06-19 06:36:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997941
2013-06-19 06:36:07 [DEBUG   ] Finished updating board flags in 2.194 seconds
2013-06-19 06:36:12 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2013-06-19 06:36:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 06:36:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-19 06:37:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-19 06:37:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-19 06:37:07 [DEBUG   ] Finished updating board flags in 2.016 seconds
2013-06-19 06:37:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 06:37:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 06:37:40 [DEBUG   ] Got command RPT from MCS: ref #11624
2013-06-19 06:37:40 [DEBUG   ] summary = ERROR
2013-06-19 06:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11624  13 56462 23860701 A  ERRORERROR'
2013-06-19 06:37:40 [DEBUG   ] Got command RPT from MCS: ref #11625
2013-06-19 06:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 06:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11625  77 56462 23860702 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 06:37:52 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-19 06:38:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-19 06:38:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 06:38:07 [DEBUG   ] Finished updating board flags in 2.017 seconds
2013-06-19 06:38:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 06:38:32 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2013-06-19 06:38:53 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-19 06:39:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 06:39:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 06:39:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 06:39:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 06:39:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 06:39:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 06:39:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 06:39:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 06:39:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 06:39:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 06:39:07 [DEBUG   ] Finished updating board flags in 1.961 seconds
2013-06-19 06:39:13 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-19 06:39:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 06:39:53 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 06:40:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 06:40:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 06:40:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 06:40:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 06:40:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 06:40:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 06:40:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 06:40:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 06:40:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 06:40:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 06:40:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 06:40:07 [DEBUG   ] Finished updating board flags in 1.818 seconds
2013-06-19 06:40:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 06:40:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 06:40:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 06:41:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 06:41:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 06:41:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 06:41:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 06:41:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 06:41:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 06:41:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 06:41:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 06:41:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 06:41:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 06:41:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-19 06:41:07 [DEBUG   ] Finished updating board flags in 1.779 seconds
2013-06-19 06:41:13 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 06:41:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 06:41:53 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-19 06:42:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 06:42:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 06:42:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 06:42:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 06:42:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 06:42:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 06:42:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 06:42:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 06:42:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 06:42:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 06:42:07 [DEBUG   ] Finished updating board flags in 1.616 seconds
2013-06-19 06:42:13 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 06:42:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 06:42:40 [DEBUG   ] Got command RPT from MCS: ref #11641
2013-06-19 06:42:40 [DEBUG   ] summary = ERROR
2013-06-19 06:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11641  13 56462 24160705 A  ERRORERROR'
2013-06-19 06:42:40 [DEBUG   ] Got command RPT from MCS: ref #11642
2013-06-19 06:42:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 06:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11642  77 56462 24160706 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 06:42:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 06:43:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 06:43:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 06:43:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 06:43:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 06:43:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 06:43:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 06:43:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 06:43:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 06:43:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 06:43:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 06:43:07 [DEBUG   ] Finished updating board flags in 1.608 seconds
2013-06-19 06:43:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 06:43:33 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-19 06:43:54 [DEBUG   ] Finished updating ant stats in 1.598 seconds
2013-06-19 06:44:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 06:44:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 06:44:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 06:44:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 06:44:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 06:44:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 06:44:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 06:44:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 06:44:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 06:44:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 06:44:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-06-19 06:44:07 [CRITICAL] MGT underflow detected on beam(s) 1
2013-06-19 06:44:07 [DEBUG   ] Finished updating board flags in 1.588 seconds
2013-06-19 06:44:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2013-06-19 06:44:34 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2013-06-19 06:44:53 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-06-19 06:45:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 06:45:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 06:45:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 06:45:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 06:45:06 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 06:45:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 06:45:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 06:45:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 06:45:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 06:45:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 06:45:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 06:45:07 [DEBUG   ] Finished updating board flags in 1.661 seconds
2013-06-19 06:45:13 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-19 06:45:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 06:45:54 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 06:46:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 06:46:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 06:46:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 06:46:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 06:46:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 06:46:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 06:46:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 06:46:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 06:46:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 06:46:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 06:46:08 [DEBUG   ] Finished updating board flags in 2.430 seconds
2013-06-19 06:46:14 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-19 06:46:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 06:46:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 06:47:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 06:47:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 06:47:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 06:47:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 06:47:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 06:47:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 06:47:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 06:47:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 06:47:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 06:47:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 06:47:08 [DEBUG   ] Finished updating board flags in 2.308 seconds
2013-06-19 06:47:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 06:47:34 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-19 06:47:40 [DEBUG   ] Got command RPT from MCS: ref #11658
2013-06-19 06:47:40 [DEBUG   ] summary = ERROR
2013-06-19 06:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11658  13 56462 24460709 A  ERRORERROR'
2013-06-19 06:47:40 [DEBUG   ] Got command RPT from MCS: ref #11659
2013-06-19 06:47:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 06:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11659  77 56462 24460710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 06:47:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 06:48:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 06:48:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 06:48:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 06:48:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 06:48:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 06:48:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 06:48:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 06:48:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 06:48:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 06:48:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 06:48:08 [DEBUG   ] Finished updating board flags in 2.224 seconds
2013-06-19 06:48:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 06:48:34 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-06-19 06:48:54 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 06:49:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 06:49:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 06:49:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 06:49:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 06:49:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 06:49:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 06:49:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 06:49:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 06:49:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 06:49:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 06:49:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 06:49:08 [DEBUG   ] Finished updating board flags in 2.207 seconds
2013-06-19 06:49:15 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-19 06:49:35 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 06:49:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-19 06:50:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 06:50:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 06:50:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 06:50:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 06:50:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 06:50:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 06:50:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 06:50:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 06:50:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 06:50:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 06:50:08 [DEBUG   ] Finished updating board flags in 2.184 seconds
2013-06-19 06:50:15 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-19 06:50:35 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 06:50:55 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 06:51:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 06:51:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 06:51:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 06:51:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 06:51:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 06:51:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 06:51:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 06:51:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 06:51:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 06:51:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 06:51:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 06:51:08 [DEBUG   ] Finished updating board flags in 2.016 seconds
2013-06-19 06:51:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 06:51:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 06:51:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 06:52:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 06:52:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 06:52:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 06:52:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 06:52:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 06:52:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 06:52:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 06:52:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 06:52:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 06:52:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 06:52:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-19 06:52:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 06:52:08 [DEBUG   ] Finished updating board flags in 1.991 seconds
2013-06-19 06:52:15 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2013-06-19 06:52:35 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 06:52:40 [DEBUG   ] Got command RPT from MCS: ref #11675
2013-06-19 06:52:40 [DEBUG   ] summary = ERROR
2013-06-19 06:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11675  13 56462 24760723 A  ERRORERROR'
2013-06-19 06:52:40 [DEBUG   ] Got command RPT from MCS: ref #11676
2013-06-19 06:52:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 06:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11676  77 56462 24760723 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 06:52:55 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 06:53:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 06:53:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 06:53:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 06:53:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 06:53:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 06:53:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 06:53:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 06:53:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 06:53:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 06:53:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 06:53:08 [DEBUG   ] Finished updating board flags in 1.810 seconds
2013-06-19 06:53:16 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-19 06:53:36 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-19 06:53:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 06:54:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 06:54:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 06:54:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 06:54:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 06:54:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 06:54:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 06:54:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 06:54:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 06:54:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 06:54:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 06:54:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 06:54:08 [DEBUG   ] Finished updating board flags in 1.797 seconds
2013-06-19 06:54:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 06:54:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 06:54:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 06:55:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 06:55:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 06:55:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 06:55:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 06:55:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 06:55:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 06:55:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 06:55:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 06:55:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 06:55:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 06:55:08 [DEBUG   ] Finished updating board flags in 1.601 seconds
2013-06-19 06:55:16 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 06:55:36 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 06:55:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 06:56:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 06:56:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 06:56:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 06:56:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 06:56:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 06:56:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 06:56:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 06:56:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 06:56:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 06:56:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 06:56:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 06:56:08 [DEBUG   ] Finished updating board flags in 1.597 seconds
2013-06-19 06:56:16 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2013-06-19 06:56:36 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 06:56:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 06:57:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 06:57:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 06:57:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 06:57:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 06:57:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 06:57:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 06:57:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 06:57:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 06:57:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 06:57:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 06:57:08 [DEBUG   ] Finished updating board flags in 1.418 seconds
2013-06-19 06:57:16 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 06:57:36 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-19 06:57:40 [DEBUG   ] Got command RPT from MCS: ref #11692
2013-06-19 06:57:40 [DEBUG   ] summary = ERROR
2013-06-19 06:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11692  13 56462 25060710 A  ERRORERROR'
2013-06-19 06:57:40 [DEBUG   ] Got command RPT from MCS: ref #11693
2013-06-19 06:57:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 06:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11693  77 56462 25060710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 06:57:57 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-19 06:58:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 06:58:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 06:58:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 06:58:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 06:58:07 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 06:58:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 06:58:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 06:58:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 06:58:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 06:58:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 06:58:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 06:58:08 [DEBUG   ] Finished updating board flags in 1.387 seconds
2013-06-19 06:58:17 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-19 06:58:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-19 06:58:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 06:59:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 06:59:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 06:59:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 06:59:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 06:59:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 06:59:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 06:59:09 [DEBUG   ] Finished updating board flags in 2.165 seconds
2013-06-19 06:59:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 06:59:37 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 06:59:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 07:00:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:00:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:00:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:00:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:00:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:00:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:00:09 [DEBUG   ] Finished updating board flags in 2.010 seconds
2013-06-19 07:00:17 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 07:00:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 07:00:57 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 07:01:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:01:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:01:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:01:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:01:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:01:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:01:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:01:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:01:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:01:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:01:09 [DEBUG   ] Finished updating board flags in 1.985 seconds
2013-06-19 07:01:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 07:01:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 07:01:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 07:02:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:02:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:02:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:02:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:02:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:02:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:02:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:02:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:02:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:02:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:02:09 [DEBUG   ] Finished updating board flags in 1.809 seconds
2013-06-19 07:02:17 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 07:02:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 07:02:40 [DEBUG   ] Got command RPT from MCS: ref #11709
2013-06-19 07:02:40 [DEBUG   ] summary = ERROR
2013-06-19 07:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11709  13 56462 25360717 A  ERRORERROR'
2013-06-19 07:02:40 [DEBUG   ] Got command RPT from MCS: ref #11710
2013-06-19 07:02:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 07:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11710  77 56462 25360718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 07:02:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 07:03:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:03:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:03:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:03:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:03:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:03:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:03:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:03:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:03:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:03:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:03:09 [DEBUG   ] Finished updating board flags in 1.789 seconds
2013-06-19 07:03:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 07:03:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 07:03:58 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-19 07:04:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:04:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:04:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:04:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:04:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:04:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:04:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:04:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:04:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:04:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:04:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-19 07:04:09 [DEBUG   ] Finished updating board flags in 1.615 seconds
2013-06-19 07:04:18 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 07:04:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-19 07:04:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 07:05:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:05:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:05:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:05:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:05:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:05:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:05:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:05:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:05:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:05:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:05:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 07:05:09 [DEBUG   ] Finished updating board flags in 1.594 seconds
2013-06-19 07:05:18 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 07:05:38 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 07:05:58 [DEBUG   ] Finished updating ant stats in 0.990 seconds
2013-06-19 07:06:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:06:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:06:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:06:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:06:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:06:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:06:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 07:06:09 [DEBUG   ] Finished updating board flags in 1.409 seconds
2013-06-19 07:06:18 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 07:06:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 07:06:59 [DEBUG   ] Finished updating ant stats in 1.602 seconds
2013-06-19 07:07:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:07:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:07:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:07:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:07:08 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:07:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:07:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:07:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:07:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:07:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:07:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 07:07:09 [DEBUG   ] Finished updating board flags in 1.391 seconds
2013-06-19 07:07:18 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 07:07:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 07:07:40 [DEBUG   ] Got command RPT from MCS: ref #11726
2013-06-19 07:07:40 [DEBUG   ] summary = ERROR
2013-06-19 07:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11726  13 56462 25660709 A  ERRORERROR'
2013-06-19 07:07:40 [DEBUG   ] Got command RPT from MCS: ref #11727
2013-06-19 07:07:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 07:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11727  77 56462 25660710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 07:07:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 07:08:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:08:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:08:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:08:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:08:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:08:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:08:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:08:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:08:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:08:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:08:10 [DEBUG   ] Finished updating board flags in 2.263 seconds
2013-06-19 07:08:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 07:08:38 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-19 07:08:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 07:09:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:09:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:09:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:09:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:09:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:09:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:09:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:09:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:09:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:09:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:09:10 [DEBUG   ] Finished updating board flags in 2.215 seconds
2013-06-19 07:09:19 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-19 07:09:39 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-19 07:09:59 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 07:10:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:10:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:10:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:10:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:10:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:10:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:10:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:10:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:10:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:10:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:10:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 07:10:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 07:10:10 [DEBUG   ] Finished updating board flags in 2.167 seconds
2013-06-19 07:10:19 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-19 07:10:39 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 07:10:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 07:11:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:11:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:11:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:11:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:11:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:11:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:11:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:11:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:11:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:11:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:11:10 [DEBUG   ] Finished updating board flags in 1.992 seconds
2013-06-19 07:11:19 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 07:11:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 07:11:59 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 07:12:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:12:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:12:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:12:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:12:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:12:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:12:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:12:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:12:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:12:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:12:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 07:12:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-06-19 07:12:10 [CRITICAL] MGT underflow detected on beam(s) 1
2013-06-19 07:12:10 [DEBUG   ] Finished updating board flags in 1.808 seconds
2013-06-19 07:12:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 07:12:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 07:12:40 [DEBUG   ] Got command RPT from MCS: ref #11743
2013-06-19 07:12:40 [DEBUG   ] summary = ERROR
2013-06-19 07:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11743  13 56462 25960709 A  ERRORERROR'
2013-06-19 07:12:40 [DEBUG   ] Got command RPT from MCS: ref #11744
2013-06-19 07:12:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 07:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11744  77 56462 25960710 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 07:12:59 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-19 07:13:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:13:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:13:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:13:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:13:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:13:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:13:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:13:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:13:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:13:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:13:10 [DEBUG   ] Finished updating board flags in 1.774 seconds
2013-06-19 07:13:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 07:13:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 07:13:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 07:14:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:14:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:14:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:14:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:14:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:14:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:14:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:14:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:14:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:14:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:14:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 07:14:10 [DEBUG   ] Finished updating board flags in 1.616 seconds
2013-06-19 07:14:19 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-19 07:14:39 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 07:14:59 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 07:15:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:15:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:15:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:15:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:15:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:15:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:15:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:15:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:15:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:15:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:15:10 [DEBUG   ] Finished updating board flags in 1.589 seconds
2013-06-19 07:15:20 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2013-06-19 07:15:39 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-19 07:15:59 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2013-06-19 07:16:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:16:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:16:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:16:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:16:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:16:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-19 07:16:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:16:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:16:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:16:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:16:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:16:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 07:16:10 [DEBUG   ] Finished updating board flags in 1.439 seconds
2013-06-19 07:16:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 07:16:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 07:17:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 07:17:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:17:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:17:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:17:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:17:09 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:17:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:17:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:17:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:17:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:17:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:17:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 07:17:10 [DEBUG   ] Finished updating board flags in 1.426 seconds
2013-06-19 07:17:20 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-19 07:17:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 07:17:40 [DEBUG   ] Got command RPT from MCS: ref #11760
2013-06-19 07:17:40 [DEBUG   ] summary = ERROR
2013-06-19 07:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11760  13 56462 26260718 A  ERRORERROR'
2013-06-19 07:17:40 [DEBUG   ] Got command RPT from MCS: ref #11761
2013-06-19 07:17:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 07:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11761  77 56462 26260718 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 07:18:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 07:18:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:18:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:18:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:18:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:18:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:18:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:18:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:18:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:18:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:18:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:18:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 07:18:11 [DEBUG   ] Finished updating board flags in 2.391 seconds
2013-06-19 07:18:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 07:18:40 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2013-06-19 07:19:00 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:19:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:19:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:19:11 [DEBUG   ] Finished updating board flags in 2.149 seconds
2013-06-19 07:19:21 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-19 07:19:41 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-19 07:20:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-19 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:20:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:20:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:20:11 [DEBUG   ] Finished updating board flags in 2.016 seconds
2013-06-19 07:20:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 07:20:41 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 07:21:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 07:21:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:21:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:21:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:21:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:21:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:21:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:21:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:21:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:21:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:21:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:21:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 07:21:11 [DEBUG   ] Finished updating board flags in 1.993 seconds
2013-06-19 07:21:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 07:21:41 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 07:22:01 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 07:22:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:22:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:22:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:22:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:22:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:22:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:22:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:22:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:22:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:22:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:22:11 [DEBUG   ] Finished updating board flags in 1.806 seconds
2013-06-19 07:22:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 07:22:40 [DEBUG   ] Got command RPT from MCS: ref #11777
2013-06-19 07:22:40 [DEBUG   ] summary = ERROR
2013-06-19 07:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11777  13 56462 26560714 A  ERRORERROR'
2013-06-19 07:22:40 [DEBUG   ] Got command RPT from MCS: ref #11778
2013-06-19 07:22:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 07:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11778  77 56462 26560714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 07:22:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 07:23:01 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-19 07:23:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:23:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:23:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:23:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:23:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:23:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:23:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:23:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:23:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:23:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:23:11 [DEBUG   ] Finished updating board flags in 1.794 seconds
2013-06-19 07:23:21 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 07:23:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 07:24:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-19 07:24:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:24:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:24:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:24:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:24:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:24:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:24:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:24:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:24:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:24:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:24:11 [DEBUG   ] Finished updating board flags in 1.601 seconds
2013-06-19 07:24:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 07:24:41 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 07:25:02 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-19 07:25:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:25:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:25:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:25:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:25:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:25:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:25:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:25:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:25:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:25:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:25:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 07:25:11 [DEBUG   ] Finished updating board flags in 1.608 seconds
2013-06-19 07:25:22 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 07:25:42 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2013-06-19 07:26:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 07:26:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:26:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:26:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:26:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:26:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:26:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-19 07:26:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:26:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:26:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:26:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:26:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:26:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-19 07:26:11 [DEBUG   ] Finished updating board flags in 1.609 seconds
2013-06-19 07:26:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 07:26:42 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 07:27:02 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2013-06-19 07:27:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:27:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:27:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:27:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:27:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:27:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:27:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:27:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:27:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:27:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:27:11 [DEBUG   ] Finished updating board flags in 1.589 seconds
2013-06-19 07:27:22 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2013-06-19 07:27:40 [DEBUG   ] Got command RPT from MCS: ref #11794
2013-06-19 07:27:40 [DEBUG   ] summary = ERROR
2013-06-19 07:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11794  13 56462 26860713 A  ERRORERROR'
2013-06-19 07:27:40 [DEBUG   ] Got command RPT from MCS: ref #11795
2013-06-19 07:27:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 07:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11795  77 56462 26860714 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 07:27:42 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 07:28:02 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 07:28:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:28:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:28:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:28:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:28:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:28:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:28:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:28:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:28:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:28:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:28:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 07:28:11 [DEBUG   ] Finished updating board flags in 1.412 seconds
2013-06-19 07:28:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 07:28:43 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-19 07:29:03 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-19 07:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:29:10 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:29:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:29:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:29:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:29:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:29:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:29:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 07:29:11 [DEBUG   ] Finished updating board flags in 1.377 seconds
2013-06-19 07:29:23 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2013-06-19 07:29:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 07:30:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 07:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:30:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:30:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:30:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:30:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:30:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:30:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:30:12 [DEBUG   ] Finished updating board flags in 2.218 seconds
2013-06-19 07:30:23 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 07:30:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 07:31:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 07:31:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:31:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:31:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:31:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:31:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:31:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:31:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:31:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:31:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:31:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:31:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 07:31:12 [DEBUG   ] Finished updating board flags in 2.187 seconds
2013-06-19 07:31:23 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 07:31:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 07:32:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 07:32:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:32:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:32:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:32:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:32:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:32:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:32:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:32:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:32:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:32:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:32:12 [DEBUG   ] Finished updating board flags in 2.011 seconds
2013-06-19 07:32:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 07:32:40 [DEBUG   ] Got command RPT from MCS: ref #11811
2013-06-19 07:32:40 [DEBUG   ] summary = ERROR
2013-06-19 07:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11811  13 56462 27160721 A  ERRORERROR'
2013-06-19 07:32:40 [DEBUG   ] Got command RPT from MCS: ref #11812
2013-06-19 07:32:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 07:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11812  77 56462 27160722 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 07:32:44 [DEBUG   ] Finished updating ant stats in 1.604 seconds
2013-06-19 07:33:03 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 07:33:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:33:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:33:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:33:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:33:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:33:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:33:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:33:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:33:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:33:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:33:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 07:33:12 [DEBUG   ] Finished updating board flags in 1.997 seconds
2013-06-19 07:33:24 [DEBUG   ] Finished updating ant stats in 1.603 seconds
2013-06-19 07:33:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 07:34:04 [DEBUG   ] Finished updating ant stats in 1.603 seconds
2013-06-19 07:34:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:34:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:34:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:34:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:34:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:34:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:34:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:34:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:34:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:34:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:34:12 [DEBUG   ] Finished updating board flags in 1.809 seconds
2013-06-19 07:34:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 07:34:44 [DEBUG   ] Finished updating ant stats in 1.604 seconds
2013-06-19 07:35:03 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 07:35:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:35:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:35:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:35:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:35:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:35:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:35:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:35:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:35:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:35:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:35:12 [DEBUG   ] Finished updating board flags in 1.894 seconds
2013-06-19 07:35:23 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-19 07:35:44 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-19 07:36:04 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-19 07:36:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:36:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:36:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:36:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:36:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:36:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:36:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:36:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:36:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:36:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:36:12 [DEBUG   ] Finished updating board flags in 1.704 seconds
2013-06-19 07:36:24 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-19 07:36:44 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 07:37:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2013-06-19 07:37:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:37:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:37:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:37:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:37:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:37:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-19 07:37:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:37:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:37:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:37:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:37:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:37:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 07:37:12 [DEBUG   ] Finished updating board flags in 1.622 seconds
2013-06-19 07:37:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 07:37:40 [DEBUG   ] Got command RPT from MCS: ref #11828
2013-06-19 07:37:40 [DEBUG   ] summary = ERROR
2013-06-19 07:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11828  13 56462 27460725 A  ERRORERROR'
2013-06-19 07:37:40 [DEBUG   ] Got command RPT from MCS: ref #11829
2013-06-19 07:37:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 07:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11829  77 56462 27460726 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 07:37:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 07:38:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 07:38:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 195997745
2013-06-19 07:38:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 195997745
2013-06-19 07:38:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 195997745
2013-06-19 07:38:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 195997745
2013-06-19 07:38:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 195997745
2013-06-19 07:38:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-19 07:38:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 195997745
2013-06-19 07:38:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 195997745
2013-06-19 07:38:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 195997745
2013-06-19 07:38:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 195997745
2013-06-19 07:38:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 195997745
2013-06-19 07:38:12 [DEBUG   ] Finished updating board flags in 1.582 seconds
2013-06-19 07:38:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 07:38:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 07:39:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192715402
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192715080
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192715334
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192714629
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192715141
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 1, top port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 1, bottom port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 5, top port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa27, chip 5, bottom port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 1, top port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 1, bottom port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa24, chip 5, bottom port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 1, top port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 1, bottom port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 5, top port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa23, chip 5, bottom port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 1, top port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 1, bottom port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 5, top port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa18, chip 5, bottom port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 1, top port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 1, bottom port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 5, top port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa10, chip 5, bottom port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 1, top port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 1, bottom port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 5, top port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa32, chip 5, bottom port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 1, top port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 1, bottom port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 5, top port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa11, chip 5, bottom port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 1, top port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 1, bottom port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 5, top port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa30, chip 5, bottom port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 1, top port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 1, bottom port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 5, top port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa12, chip 5, bottom port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 1, top port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 5, top port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa8, chip 5, bottom port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 1, top port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 1, bottom port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 5, top port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa13, chip 5, bottom port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, top port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 121067062
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 5, top port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 5, bottom port
2013-06-19 07:39:11 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 1, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 2, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 4, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa14, chip 5, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546925
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546918
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192547057
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192547088
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546935
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 1, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 1, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 5, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa22, chip 5, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 1, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 1, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa20, chip 5, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 1, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 1, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 5, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa1, chip 5, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 1, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 1, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 5, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa5, chip 5, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 1, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 1, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 5, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa25, chip 5, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 1, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 1, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 5, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa35, chip 5, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 1, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 1, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 5, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa19, chip 5, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 1, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 1, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 5, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa21, chip 5, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 1, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 1, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 5, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa6, chip 5, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 1, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 1, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 1, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 5, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa33, chip 5, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 1, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 1, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 5, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa15, chip 5, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 1, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 2, top port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 4, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 121067062
2013-06-19 07:39:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa28, chip 5, bottom port
2013-06-19 07:39:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 121067062
2013-06-19 07:39:12 [CRITICAL] MGT underflow detected on beam(s) 1, 4, 2, 3
2013-06-19 07:39:12 [DEBUG   ] Finished updating board flags in 1.471 seconds
2013-06-19 07:39:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 07:39:44 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 07:40:05 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192715402
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192715080
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192715334
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192714629
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192715141
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-19 07:40:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546925
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546918
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192547057
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192547088
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546935
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-19 07:40:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-19 07:40:13 [DEBUG   ] Finished updating board flags in 2.365 seconds
2013-06-19 07:40:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 07:40:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 07:41:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 07:41:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192715402
2013-06-19 07:41:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192715080
2013-06-19 07:41:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192715334
2013-06-19 07:41:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192714629
2013-06-19 07:41:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192715141
2013-06-19 07:41:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546925
2013-06-19 07:41:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546918
2013-06-19 07:41:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192547057
2013-06-19 07:41:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192547088
2013-06-19 07:41:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546935
2013-06-19 07:41:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 07:41:13 [DEBUG   ] Finished updating board flags in 2.170 seconds
2013-06-19 07:41:25 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 07:41:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 07:42:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 07:42:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192715402
2013-06-19 07:42:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192715080
2013-06-19 07:42:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192715334
2013-06-19 07:42:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192714629
2013-06-19 07:42:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192715141
2013-06-19 07:42:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546925
2013-06-19 07:42:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546918
2013-06-19 07:42:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192547057
2013-06-19 07:42:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192547088
2013-06-19 07:42:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546935
2013-06-19 07:42:13 [DEBUG   ] Finished updating board flags in 2.028 seconds
2013-06-19 07:42:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 07:42:40 [DEBUG   ] Got command RPT from MCS: ref #11845
2013-06-19 07:42:40 [DEBUG   ] summary = ERROR
2013-06-19 07:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11845  13 56462 27760725 A  ERRORERROR'
2013-06-19 07:42:40 [DEBUG   ] Got command RPT from MCS: ref #11846
2013-06-19 07:42:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 07:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11846  98 56462 27760726 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 07:42:45 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-19 07:43:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 07:43:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192715402
2013-06-19 07:43:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192715080
2013-06-19 07:43:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192715334
2013-06-19 07:43:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192714629
2013-06-19 07:43:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192715141
2013-06-19 07:43:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546925
2013-06-19 07:43:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546918
2013-06-19 07:43:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192547057
2013-06-19 07:43:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192547088
2013-06-19 07:43:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546935
2013-06-19 07:43:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-19 07:43:13 [DEBUG   ] Finished updating board flags in 1.988 seconds
2013-06-19 07:43:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 07:43:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 07:44:05 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-19 07:44:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192715402
2013-06-19 07:44:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192715080
2013-06-19 07:44:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192715334
2013-06-19 07:44:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192714629
2013-06-19 07:44:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192715141
2013-06-19 07:44:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546925
2013-06-19 07:44:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546918
2013-06-19 07:44:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192547057
2013-06-19 07:44:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192547088
2013-06-19 07:44:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546935
2013-06-19 07:44:13 [DEBUG   ] Finished updating board flags in 1.811 seconds
2013-06-19 07:44:26 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-19 07:44:46 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-19 07:45:06 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-19 07:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192715402
2013-06-19 07:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192715080
2013-06-19 07:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192715334
2013-06-19 07:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192714629
2013-06-19 07:45:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192715141
2013-06-19 07:45:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546925
2013-06-19 07:45:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546918
2013-06-19 07:45:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192547057
2013-06-19 07:45:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192547088
2013-06-19 07:45:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546935
2013-06-19 07:45:13 [DEBUG   ] Finished updating board flags in 1.775 seconds
2013-06-19 07:45:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 07:45:46 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 07:46:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192715108
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714786
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192715040
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192714335
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714847
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-19 07:46:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546631
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546624
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546763
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546794
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546641
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-19 07:46:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-19 07:46:13 [DEBUG   ] Finished updating board flags in 1.638 seconds
2013-06-19 07:46:26 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 07:46:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 07:47:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192715108
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714786
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192715040
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192714335
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714847
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-19 07:47:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546631
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546624
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546763
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546794
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546641
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-19 07:47:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-19 07:47:13 [DEBUG   ] Finished updating board flags in 1.598 seconds
2013-06-19 07:47:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 07:47:40 [DEBUG   ] Got command RPT from MCS: ref #11862
2013-06-19 07:47:40 [DEBUG   ] summary = ERROR
2013-06-19 07:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11862  13 56462 28060721 A  ERRORERROR'
2013-06-19 07:47:40 [DEBUG   ] Got command RPT from MCS: ref #11863
2013-06-19 07:47:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 07:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11863  98 56462 28060722 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 07:47:46 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-19 07:48:06 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714912
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714590
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714844
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192714139
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714651
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-19 07:48:12 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546435
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546428
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546567
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546598
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546445
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-19 07:48:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-19 07:48:13 [DEBUG   ] Finished updating board flags in 1.396 seconds
2013-06-19 07:48:26 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 07:48:46 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 07:49:07 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714912
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714590
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714844
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192714139
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714651
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-19 07:49:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546435
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546428
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546567
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546598
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546445
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-19 07:49:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-19 07:49:14 [DEBUG   ] Finished updating board flags in 2.216 seconds
2013-06-19 07:49:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 07:49:47 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-19 07:50:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 07:50:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714912
2013-06-19 07:50:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714590
2013-06-19 07:50:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714844
2013-06-19 07:50:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192714139
2013-06-19 07:50:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714651
2013-06-19 07:50:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546435
2013-06-19 07:50:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546428
2013-06-19 07:50:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546567
2013-06-19 07:50:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546598
2013-06-19 07:50:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546445
2013-06-19 07:50:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 07:50:14 [DEBUG   ] Finished updating board flags in 2.167 seconds
2013-06-19 07:50:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 07:50:47 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 07:51:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 07:51:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714912
2013-06-19 07:51:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714590
2013-06-19 07:51:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714844
2013-06-19 07:51:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192714139
2013-06-19 07:51:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714651
2013-06-19 07:51:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546435
2013-06-19 07:51:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546428
2013-06-19 07:51:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546567
2013-06-19 07:51:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546598
2013-06-19 07:51:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546445
2013-06-19 07:51:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 07:51:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 07:51:14 [DEBUG   ] Finished updating board flags in 2.021 seconds
2013-06-19 07:51:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 07:51:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 07:52:07 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 07:52:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714912
2013-06-19 07:52:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714590
2013-06-19 07:52:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714844
2013-06-19 07:52:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192714139
2013-06-19 07:52:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714651
2013-06-19 07:52:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546435
2013-06-19 07:52:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546428
2013-06-19 07:52:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546567
2013-06-19 07:52:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546598
2013-06-19 07:52:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546445
2013-06-19 07:52:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-19 07:52:14 [DEBUG   ] Finished updating board flags in 1.986 seconds
2013-06-19 07:52:27 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 07:52:40 [DEBUG   ] Got command RPT from MCS: ref #11879
2013-06-19 07:52:40 [DEBUG   ] summary = ERROR
2013-06-19 07:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11879  13 56462 28360734 A  ERRORERROR'
2013-06-19 07:52:40 [DEBUG   ] Got command RPT from MCS: ref #11880
2013-06-19 07:52:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 07:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11880  98 56462 28360734 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 07:52:48 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-19 07:53:08 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 07:53:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714912
2013-06-19 07:53:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714590
2013-06-19 07:53:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714844
2013-06-19 07:53:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192714139
2013-06-19 07:53:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714651
2013-06-19 07:53:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546435
2013-06-19 07:53:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546428
2013-06-19 07:53:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546567
2013-06-19 07:53:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546598
2013-06-19 07:53:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546445
2013-06-19 07:53:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 07:53:14 [DEBUG   ] Finished updating board flags in 1.819 seconds
2013-06-19 07:53:28 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-19 07:53:48 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 07:54:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714716
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714394
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714648
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713943
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714455
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-19 07:54:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546239
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546232
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546371
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546402
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546249
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-19 07:54:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-19 07:54:14 [DEBUG   ] Finished updating board flags in 1.799 seconds
2013-06-19 07:54:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 07:54:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 07:55:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714716
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714394
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714648
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713943
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714455
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-19 07:55:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546239
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546232
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546371
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546402
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546249
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-19 07:55:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-19 07:55:14 [DEBUG   ] Finished updating board flags in 1.617 seconds
2013-06-19 07:55:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 07:55:48 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 07:56:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-19 07:56:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-19 07:56:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-19 07:56:14 [DEBUG   ] Finished updating board flags in 1.584 seconds
2013-06-19 07:56:28 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 07:56:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 07:57:09 [DEBUG   ] Finished updating ant stats in 1.601 seconds
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-19 07:57:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-19 07:57:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 07:57:14 [DEBUG   ] Finished updating board flags in 1.416 seconds
2013-06-19 07:57:28 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 07:57:40 [DEBUG   ] Got command RPT from MCS: ref #11896
2013-06-19 07:57:40 [DEBUG   ] summary = ERROR
2013-06-19 07:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11896  13 56462 28660722 A  ERRORERROR'
2013-06-19 07:57:40 [DEBUG   ] Got command RPT from MCS: ref #11897
2013-06-19 07:57:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 07:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11897  98 56462 28660722 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 07:57:49 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-06-19 07:58:08 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-19 07:58:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 07:58:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 07:58:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 07:58:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 07:58:13 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 07:58:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 07:58:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 07:58:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 07:58:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 07:58:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 07:58:14 [DEBUG   ] Finished updating board flags in 1.532 seconds
2013-06-19 07:58:29 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 07:58:49 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 07:59:09 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 07:59:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 07:59:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 07:59:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 07:59:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 07:59:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 07:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 07:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 07:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 07:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 07:59:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 07:59:15 [DEBUG   ] Finished updating board flags in 2.375 seconds
2013-06-19 07:59:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 07:59:49 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 08:00:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 08:00:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:00:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:00:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:00:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:00:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:00:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:00:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:00:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:00:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:00:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:00:15 [DEBUG   ] Finished updating board flags in 2.214 seconds
2013-06-19 08:00:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 08:00:49 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 08:01:09 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-19 08:01:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:01:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:01:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:01:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:01:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:01:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:01:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:01:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:01:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:01:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:01:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 08:01:15 [DEBUG   ] Finished updating board flags in 2.074 seconds
2013-06-19 08:01:29 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 08:01:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 08:02:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 08:02:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:02:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:02:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:02:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:02:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:02:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:02:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:02:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:02:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:02:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:02:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 08:02:15 [DEBUG   ] Finished updating board flags in 2.029 seconds
2013-06-19 08:02:29 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-19 08:02:40 [DEBUG   ] Got command RPT from MCS: ref #11913
2013-06-19 08:02:40 [DEBUG   ] summary = ERROR
2013-06-19 08:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11913  13 56462 28960729 A  ERRORERROR'
2013-06-19 08:02:40 [DEBUG   ] Got command RPT from MCS: ref #11914
2013-06-19 08:02:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 08:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11914  98 56462 28960730 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 08:02:49 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2013-06-19 08:03:09 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-19 08:03:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:03:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:03:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:03:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:03:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:03:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:03:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:03:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:03:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:03:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:03:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 08:03:15 [DEBUG   ] Finished updating board flags in 1.968 seconds
2013-06-19 08:03:30 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-19 08:03:50 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 08:04:10 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 08:04:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:04:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:04:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:04:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:04:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:04:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:04:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:04:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:04:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:04:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:04:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 08:04:15 [DEBUG   ] Finished updating board flags in 1.827 seconds
2013-06-19 08:04:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 08:04:50 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 08:05:10 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 08:05:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:05:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:05:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:05:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:05:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:05:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:05:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:05:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:05:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:05:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:05:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 08:05:15 [DEBUG   ] Finished updating board flags in 1.786 seconds
2013-06-19 08:05:30 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 08:05:50 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2013-06-19 08:06:10 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-19 08:06:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:06:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:06:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:06:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:06:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:06:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:06:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:06:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:06:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:06:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:06:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 08:06:15 [DEBUG   ] Finished updating board flags in 1.608 seconds
2013-06-19 08:06:30 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 08:06:50 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 08:07:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:07:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:07:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:07:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:07:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:07:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:07:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:07:15 [DEBUG   ] Finished updating board flags in 1.585 seconds
2013-06-19 08:07:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 08:07:40 [DEBUG   ] Got command RPT from MCS: ref #11930
2013-06-19 08:07:40 [DEBUG   ] summary = ERROR
2013-06-19 08:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11930  13 56462 29260725 A  ERRORERROR'
2013-06-19 08:07:40 [DEBUG   ] Got command RPT from MCS: ref #11931
2013-06-19 08:07:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 08:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11931  98 56462 29260726 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 08:07:50 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 08:08:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:08:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:08:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:08:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:08:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:08:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:08:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:08:15 [DEBUG   ] Finished updating board flags in 1.422 seconds
2013-06-19 08:08:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 08:08:51 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-06-19 08:09:10 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 08:09:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:09:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:09:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:09:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:09:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:09:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:09:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:09:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:09:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:09:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:09:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 08:09:15 [DEBUG   ] Finished updating board flags in 1.404 seconds
2013-06-19 08:09:31 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2013-06-19 08:09:51 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-19 08:10:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:10:14 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:10:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:10:15 [DEBUG   ] Finished updating board flags in 1.392 seconds
2013-06-19 08:10:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 08:10:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 08:11:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:11:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:11:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:11:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:11:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:11:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:11:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:11:16 [DEBUG   ] Finished updating board flags in 2.203 seconds
2013-06-19 08:11:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 08:11:51 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 08:12:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 08:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:12:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:12:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:12:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:12:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:12:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:12:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:12:16 [DEBUG   ] Finished updating board flags in 2.235 seconds
2013-06-19 08:12:31 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 08:12:40 [DEBUG   ] Got command RPT from MCS: ref #11947
2013-06-19 08:12:40 [DEBUG   ] summary = ERROR
2013-06-19 08:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11947  13 56462 29560729 A  ERRORERROR'
2013-06-19 08:12:40 [DEBUG   ] Got command RPT from MCS: ref #11948
2013-06-19 08:12:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 08:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11948  98 56462 29560730 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 08:12:51 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 08:13:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 08:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:13:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:13:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:13:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 08:13:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-19 08:13:16 [DEBUG   ] Finished updating board flags in 2.165 seconds
2013-06-19 08:13:31 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 08:13:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 08:14:11 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 08:14:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:14:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:14:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:14:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:14:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:14:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:14:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:14:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:14:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:14:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:14:16 [DEBUG   ] Finished updating board flags in 2.015 seconds
2013-06-19 08:14:32 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-19 08:14:52 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-19 08:15:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 08:15:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:15:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:15:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:15:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:15:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:15:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:15:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:15:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:15:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:15:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:15:16 [DEBUG   ] Finished updating board flags in 2.017 seconds
2013-06-19 08:15:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 08:15:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 08:16:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 08:16:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:16:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:16:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:16:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:16:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:16:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:16:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:16:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:16:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:16:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:16:16 [DEBUG   ] Finished updating board flags in 1.977 seconds
2013-06-19 08:16:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 08:16:52 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-19 08:17:12 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 08:17:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:17:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:17:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:17:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:17:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:17:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:17:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:17:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:17:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:17:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:17:16 [DEBUG   ] Finished updating board flags in 1.805 seconds
2013-06-19 08:17:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 08:17:40 [DEBUG   ] Got command RPT from MCS: ref #11964
2013-06-19 08:17:40 [DEBUG   ] summary = ERROR
2013-06-19 08:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11964  13 56462 29860730 A  ERRORERROR'
2013-06-19 08:17:40 [DEBUG   ] Got command RPT from MCS: ref #11965
2013-06-19 08:17:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 08:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11965  98 56462 29860730 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 08:17:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 08:18:12 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 08:18:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:18:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:18:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:18:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:18:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:18:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:18:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:18:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:18:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:18:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:18:16 [DEBUG   ] Finished updating board flags in 1.820 seconds
2013-06-19 08:18:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 08:18:52 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-19 08:19:13 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-19 08:19:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:19:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:19:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:19:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:19:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:19:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:19:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:19:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:19:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:19:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:19:16 [DEBUG   ] Finished updating board flags in 1.774 seconds
2013-06-19 08:19:33 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 08:19:53 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 08:20:13 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 08:20:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:20:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:20:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:20:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:20:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:20:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:20:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:20:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:20:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:20:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:20:16 [DEBUG   ] Finished updating board flags in 1.645 seconds
2013-06-19 08:20:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 08:20:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 08:21:13 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 08:21:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:21:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:21:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:21:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:21:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:21:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:21:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:21:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:21:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:21:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:21:16 [DEBUG   ] Finished updating board flags in 1.554 seconds
2013-06-19 08:21:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 08:21:53 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 08:22:13 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-19 08:22:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:22:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:22:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:22:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:22:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:22:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:22:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:22:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:22:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:22:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:22:16 [DEBUG   ] Finished updating board flags in 1.440 seconds
2013-06-19 08:22:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 08:22:40 [DEBUG   ] Got command RPT from MCS: ref #11981
2013-06-19 08:22:40 [DEBUG   ] summary = ERROR
2013-06-19 08:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11981  13 56462 30160725 A  ERRORERROR'
2013-06-19 08:22:40 [DEBUG   ] Got command RPT from MCS: ref #11982
2013-06-19 08:22:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 08:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11982  98 56462 30160726 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 08:22:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 08:23:14 [DEBUG   ] Finished updating ant stats in 1.600 seconds
2013-06-19 08:23:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:23:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:23:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:23:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:23:15 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:23:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:23:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:23:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:23:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:23:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:23:16 [DEBUG   ] Finished updating board flags in 1.361 seconds
2013-06-19 08:23:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 08:23:54 [DEBUG   ] Finished updating ant stats in 1.596 seconds
2013-06-19 08:24:13 [DEBUG   ] Finished updating ant stats in 0.408 seconds
2013-06-19 08:24:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:24:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:24:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:24:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:24:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:24:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:24:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:24:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:24:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:24:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:24:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 08:24:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-19 08:24:17 [DEBUG   ] Finished updating board flags in 2.217 seconds
2013-06-19 08:24:34 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-06-19 08:24:54 [DEBUG   ] Finished updating ant stats in 1.393 seconds
2013-06-19 08:25:14 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 08:25:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:25:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:25:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:25:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:25:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:25:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:25:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:25:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:25:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:25:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:25:17 [DEBUG   ] Finished updating board flags in 2.209 seconds
2013-06-19 08:25:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 08:25:54 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 08:26:14 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 08:26:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:26:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:26:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:26:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:26:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:26:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:26:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:26:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:26:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:26:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:26:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 08:26:17 [DEBUG   ] Finished updating board flags in 2.189 seconds
2013-06-19 08:26:34 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 08:26:54 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 08:27:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 08:27:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:27:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:27:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:27:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:27:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:27:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:27:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:27:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:27:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:27:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:27:17 [DEBUG   ] Finished updating board flags in 2.016 seconds
2013-06-19 08:27:34 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 08:27:40 [DEBUG   ] Got command RPT from MCS: ref #11998
2013-06-19 08:27:40 [DEBUG   ] summary = ERROR
2013-06-19 08:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11998  13 56462 30460729 A  ERRORERROR'
2013-06-19 08:27:40 [DEBUG   ] Got command RPT from MCS: ref #11999
2013-06-19 08:27:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 08:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    11999  98 56462 30460730 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 08:27:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 08:28:15 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-06-19 08:28:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:28:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:28:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:28:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:28:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:28:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:28:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:28:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:28:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:28:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:28:17 [DEBUG   ] Finished updating board flags in 1.988 seconds
2013-06-19 08:28:34 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-19 08:28:55 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-19 08:29:15 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 08:29:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:29:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:29:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:29:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:29:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:29:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:29:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:29:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:29:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:29:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:29:17 [DEBUG   ] Finished updating board flags in 1.812 seconds
2013-06-19 08:29:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 08:29:55 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 08:30:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 08:30:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:30:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:30:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:30:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:30:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:30:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:30:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:30:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:30:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:30:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:30:17 [DEBUG   ] Finished updating board flags in 1.816 seconds
2013-06-19 08:30:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 08:30:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 08:31:15 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2013-06-19 08:31:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:31:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:31:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:31:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:31:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:31:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:31:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:31:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:31:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:31:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:31:17 [DEBUG   ] Finished updating board flags in 1.773 seconds
2013-06-19 08:31:35 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 08:31:55 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 08:32:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:32:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:32:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:32:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:32:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:32:16 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-19 08:32:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:32:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:32:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:32:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:32:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:32:17 [DEBUG   ] Finished updating board flags in 1.618 seconds
2013-06-19 08:32:36 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 08:32:40 [DEBUG   ] Got command RPT from MCS: ref #12015
2013-06-19 08:32:40 [DEBUG   ] summary = ERROR
2013-06-19 08:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12015  13 56462 30760730 A  ERRORERROR'
2013-06-19 08:32:40 [DEBUG   ] Got command RPT from MCS: ref #12016
2013-06-19 08:32:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 08:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12016  98 56462 30760730 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 08:32:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 08:33:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:33:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:33:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:33:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:33:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:33:16 [DEBUG   ] Finished updating ant stats in 1.251 seconds
2013-06-19 08:33:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:33:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:33:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:33:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:33:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:33:17 [DEBUG   ] Finished updating board flags in 1.582 seconds
2013-06-19 08:33:36 [DEBUG   ] Finished updating ant stats in 1.156 seconds
2013-06-19 08:33:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 08:34:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:34:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:34:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:34:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:34:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:34:16 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2013-06-19 08:34:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:34:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:34:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:34:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:34:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:34:17 [DEBUG   ] Finished updating board flags in 1.415 seconds
2013-06-19 08:34:36 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2013-06-19 08:34:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 08:35:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:35:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:35:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:35:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:35:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:35:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:35:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:35:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:35:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:35:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:35:17 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-19 08:35:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 08:35:17 [DEBUG   ] Finished updating board flags in 1.414 seconds
2013-06-19 08:35:37 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-19 08:35:57 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 08:36:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:36:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:36:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:36:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:36:16 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:36:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:36:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:36:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:36:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:36:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:36:17 [DEBUG   ] Finished updating ant stats in 1.244 seconds
2013-06-19 08:36:17 [DEBUG   ] Finished updating board flags in 1.455 seconds
2013-06-19 08:36:37 [DEBUG   ] Finished updating ant stats in 1.157 seconds
2013-06-19 08:36:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 08:37:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:37:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:37:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:37:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:37:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:37:17 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2013-06-19 08:37:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:37:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:37:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:37:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:37:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:37:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 08:37:18 [DEBUG   ] Finished updating board flags in 2.341 seconds
2013-06-19 08:37:37 [DEBUG   ] Finished updating ant stats in 0.957 seconds
2013-06-19 08:37:40 [DEBUG   ] Got command RPT from MCS: ref #12032
2013-06-19 08:37:40 [DEBUG   ] summary = ERROR
2013-06-19 08:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12032  13 56462 31060729 A  ERRORERROR'
2013-06-19 08:37:40 [DEBUG   ] Got command RPT from MCS: ref #12033
2013-06-19 08:37:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 08:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12033  98 56462 31060730 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 08:37:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 08:38:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:38:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:38:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:38:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:38:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:38:17 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2013-06-19 08:38:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:38:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:38:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:38:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:38:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:38:18 [DEBUG   ] Finished updating board flags in 2.207 seconds
2013-06-19 08:38:37 [DEBUG   ] Finished updating ant stats in 0.756 seconds
2013-06-19 08:38:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 08:39:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:39:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:39:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:39:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:39:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:39:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:39:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:39:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:39:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:39:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:39:18 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-19 08:39:18 [DEBUG   ] Finished updating board flags in 2.183 seconds
2013-06-19 08:39:37 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-19 08:39:58 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-19 08:40:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:40:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:40:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:40:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:40:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:40:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:40:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:40:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:40:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:40:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:40:18 [DEBUG   ] Finished updating ant stats in 1.248 seconds
2013-06-19 08:40:18 [DEBUG   ] Finished updating board flags in 2.072 seconds
2013-06-19 08:40:38 [DEBUG   ] Finished updating ant stats in 1.157 seconds
2013-06-19 08:40:58 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 08:41:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:41:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:41:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:41:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:41:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:41:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:41:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:41:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:41:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:41:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:41:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 08:41:18 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2013-06-19 08:41:18 [DEBUG   ] Finished updating board flags in 2.014 seconds
2013-06-19 08:41:38 [DEBUG   ] Finished updating ant stats in 0.761 seconds
2013-06-19 08:41:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 08:42:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:42:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:42:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:42:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:42:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:42:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:42:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:42:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:42:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:42:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:42:18 [DEBUG   ] Finished updating ant stats in 0.642 seconds
2013-06-19 08:42:18 [DEBUG   ] Finished updating board flags in 1.979 seconds
2013-06-19 08:42:38 [DEBUG   ] Finished updating ant stats in 0.560 seconds
2013-06-19 08:42:40 [DEBUG   ] Got command RPT from MCS: ref #12049
2013-06-19 08:42:40 [DEBUG   ] summary = ERROR
2013-06-19 08:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12049  13 56462 31360737 A  ERRORERROR'
2013-06-19 08:42:40 [DEBUG   ] Got command RPT from MCS: ref #12050
2013-06-19 08:42:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 08:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12050  98 56462 31360738 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 08:42:59 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-19 08:43:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:43:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:43:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:43:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:43:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:43:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:43:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:43:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:43:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:43:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:43:18 [DEBUG   ] Finished updating board flags in 1.844 seconds
2013-06-19 08:43:19 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 08:43:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 08:43:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 08:44:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:44:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:44:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:44:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:44:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:44:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:44:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:44:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:44:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:44:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:44:18 [DEBUG   ] Finished updating board flags in 1.754 seconds
2013-06-19 08:44:19 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 08:44:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 08:44:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 08:45:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:45:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:45:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:45:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:45:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:45:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:45:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:45:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:45:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:45:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:45:18 [DEBUG   ] Finished updating board flags in 1.666 seconds
2013-06-19 08:45:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 08:45:39 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 08:45:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 08:46:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:46:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:46:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:46:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:46:17 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:46:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:46:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:46:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:46:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:46:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:46:18 [DEBUG   ] Finished updating board flags in 1.561 seconds
2013-06-19 08:46:19 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 08:46:39 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-19 08:46:59 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 08:47:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:47:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:47:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:47:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:47:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:47:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:47:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:47:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:47:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:47:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:47:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 08:47:19 [DEBUG   ] Finished updating ant stats in 0.645 seconds
2013-06-19 08:47:19 [DEBUG   ] Finished updating board flags in 2.402 seconds
2013-06-19 08:47:39 [DEBUG   ] Finished updating ant stats in 0.556 seconds
2013-06-19 08:47:40 [DEBUG   ] Got command RPT from MCS: ref #12066
2013-06-19 08:47:40 [DEBUG   ] summary = ERROR
2013-06-19 08:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12066  13 56462 31660730 A  ERRORERROR'
2013-06-19 08:47:40 [DEBUG   ] Got command RPT from MCS: ref #12067
2013-06-19 08:47:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 08:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12067  98 56462 31660730 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 08:47:59 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-19 08:48:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:48:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:48:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:48:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:48:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:48:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:48:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:48:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:48:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:48:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:48:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 08:48:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 08:48:19 [DEBUG   ] Finished updating board flags in 2.418 seconds
2013-06-19 08:48:20 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-19 08:48:40 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 08:49:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 08:49:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:49:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:49:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:49:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:49:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:49:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:49:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:49:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:49:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:49:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:49:19 [DEBUG   ] Finished updating board flags in 2.382 seconds
2013-06-19 08:49:20 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 08:49:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 08:50:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 08:50:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:50:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:50:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:50:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:50:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:50:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:50:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:50:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:50:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:50:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:50:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 08:50:19 [DEBUG   ] Finished updating board flags in 2.254 seconds
2013-06-19 08:50:20 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2013-06-19 08:50:40 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 08:51:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 08:51:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:51:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:51:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:51:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:51:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:51:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:51:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:51:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:51:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:51:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:51:19 [DEBUG   ] Finished updating board flags in 2.158 seconds
2013-06-19 08:51:20 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 08:51:40 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 08:52:00 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 08:52:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:52:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:52:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:52:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:52:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:52:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:52:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:52:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:52:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:52:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:52:19 [DEBUG   ] Finished updating board flags in 2.022 seconds
2013-06-19 08:52:21 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-19 08:52:40 [DEBUG   ] Got command RPT from MCS: ref #12083
2013-06-19 08:52:40 [DEBUG   ] summary = ERROR
2013-06-19 08:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12083  13 56462 31960738 A  ERRORERROR'
2013-06-19 08:52:40 [DEBUG   ] Got command RPT from MCS: ref #12084
2013-06-19 08:52:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 08:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12084  98 56462 31960738 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 08:52:41 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-19 08:53:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2013-06-19 08:53:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:53:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:53:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:53:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:53:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:53:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:53:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:53:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:53:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:53:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:53:19 [DEBUG   ] Finished updating board flags in 1.923 seconds
2013-06-19 08:53:21 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 08:53:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 08:54:01 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 08:54:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:54:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:54:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:54:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:54:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:54:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:54:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:54:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:54:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:54:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:54:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 08:54:19 [DEBUG   ] Finished updating board flags in 1.815 seconds
2013-06-19 08:54:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 08:54:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 08:55:01 [DEBUG   ] Finished updating ant stats in 0.806 seconds
2013-06-19 08:55:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:55:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:55:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:55:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:55:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:55:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:55:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:55:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:55:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:55:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:55:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 08:55:19 [DEBUG   ] Finished updating board flags in 1.778 seconds
2013-06-19 08:55:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 08:55:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 08:56:01 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 08:56:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:56:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:56:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:56:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:56:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:56:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:56:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:56:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:56:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:56:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:56:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 08:56:19 [DEBUG   ] Finished updating board flags in 1.622 seconds
2013-06-19 08:56:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 08:56:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 08:57:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2013-06-19 08:57:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:57:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:57:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:57:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:57:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:57:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:57:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:57:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:57:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:57:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:57:19 [DEBUG   ] Finished updating board flags in 1.593 seconds
2013-06-19 08:57:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 08:57:40 [DEBUG   ] Got command RPT from MCS: ref #12100
2013-06-19 08:57:40 [DEBUG   ] summary = ERROR
2013-06-19 08:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12100  13 56462 32260734 A  ERRORERROR'
2013-06-19 08:57:40 [DEBUG   ] Got command RPT from MCS: ref #12101
2013-06-19 08:57:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 08:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12101  98 56462 32260734 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 08:57:41 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-19 08:58:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 08:58:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:58:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:58:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:58:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:58:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:58:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:58:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:58:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:58:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:58:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:58:19 [DEBUG   ] Finished updating board flags in 1.406 seconds
2013-06-19 08:58:21 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 08:58:41 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 08:59:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2013-06-19 08:59:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 08:59:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 08:59:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 08:59:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 08:59:18 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 08:59:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 08:59:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 08:59:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 08:59:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 08:59:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 08:59:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 08:59:19 [DEBUG   ] Finished updating board flags in 1.387 seconds
2013-06-19 08:59:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 08:59:41 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 09:00:01 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 09:00:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:00:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:00:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:00:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:00:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:00:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:00:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:00:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:00:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:00:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:00:20 [DEBUG   ] Finished updating board flags in 2.245 seconds
2013-06-19 09:00:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 09:00:41 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2013-06-19 09:01:02 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-19 09:01:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:01:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:01:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:01:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:01:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:01:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:01:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:01:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:01:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:01:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:01:20 [DEBUG   ] Finished updating board flags in 2.162 seconds
2013-06-19 09:01:22 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-19 09:01:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:02:02 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 09:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:02:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:02:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:02:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:02:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:02:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:02:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:02:20 [DEBUG   ] Finished updating board flags in 2.006 seconds
2013-06-19 09:02:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 09:02:40 [DEBUG   ] Got command RPT from MCS: ref #12117
2013-06-19 09:02:40 [DEBUG   ] summary = ERROR
2013-06-19 09:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12117  13 56462 32560737 A  ERRORERROR'
2013-06-19 09:02:40 [DEBUG   ] Got command RPT from MCS: ref #12118
2013-06-19 09:02:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 09:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12118  98 56462 32560738 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 09:02:42 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 09:03:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 09:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:03:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:03:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:03:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:03:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:03:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:03:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:03:20 [DEBUG   ] Finished updating board flags in 2.009 seconds
2013-06-19 09:03:22 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 09:03:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 09:04:02 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 09:04:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:04:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:04:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:04:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:04:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:04:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:04:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:04:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:04:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:04:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:04:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 09:04:20 [DEBUG   ] Finished updating board flags in 2.081 seconds
2013-06-19 09:04:22 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 09:04:42 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 09:05:02 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 09:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:05:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:05:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:05:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:05:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:05:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:05:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:05:20 [DEBUG   ] Finished updating board flags in 1.922 seconds
2013-06-19 09:05:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:05:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:06:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:06:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:06:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:06:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:06:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:06:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:06:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:06:20 [DEBUG   ] Finished updating board flags in 1.816 seconds
2013-06-19 09:06:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 09:06:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:07:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:07:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:07:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:07:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:07:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:07:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:07:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:07:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:07:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:07:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:07:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:07:20 [DEBUG   ] Finished updating board flags in 1.778 seconds
2013-06-19 09:07:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 09:07:40 [DEBUG   ] Got command RPT from MCS: ref #12134
2013-06-19 09:07:40 [DEBUG   ] summary = ERROR
2013-06-19 09:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12134  13 56462 32860741 A  ERRORERROR'
2013-06-19 09:07:40 [DEBUG   ] Got command RPT from MCS: ref #12135
2013-06-19 09:07:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 09:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12135  98 56462 32860742 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 09:07:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 09:08:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:08:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:08:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:08:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:08:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:08:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:08:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:08:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:08:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:08:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:08:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:08:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 5
2013-06-19 09:08:20 [DEBUG   ] Finished updating board flags in 1.625 seconds
2013-06-19 09:08:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:08:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:09:02 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 09:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:09:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:09:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:09:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:09:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:09:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:09:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:09:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 09:09:20 [DEBUG   ] Finished updating board flags in 1.614 seconds
2013-06-19 09:09:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:09:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:10:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:10:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:10:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:10:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:10:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:10:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:10:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:10:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 09:10:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 09:10:20 [DEBUG   ] Finished updating board flags in 1.672 seconds
2013-06-19 09:10:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 09:10:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:11:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:11:19 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:11:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:11:20 [DEBUG   ] Finished updating board flags in 1.577 seconds
2013-06-19 09:11:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:11:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 09:12:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:12:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:12:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:12:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:12:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:12:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:12:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:12:21 [DEBUG   ] Finished updating board flags in 2.440 seconds
2013-06-19 09:12:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 09:12:40 [DEBUG   ] Got command RPT from MCS: ref #12151
2013-06-19 09:12:40 [DEBUG   ] summary = ERROR
2013-06-19 09:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12151  13 56462 33160737 A  ERRORERROR'
2013-06-19 09:12:40 [DEBUG   ] Got command RPT from MCS: ref #12152
2013-06-19 09:12:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 09:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12152  98 56462 33160738 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 09:12:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 09:13:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:13:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:13:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:13:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:13:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:13:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:13:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:13:21 [DEBUG   ] Finished updating board flags in 2.441 seconds
2013-06-19 09:13:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:13:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:14:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:14:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:14:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-19 09:14:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:14:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:14:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:14:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:14:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:14:21 [DEBUG   ] Finished updating board flags in 2.261 seconds
2013-06-19 09:14:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 09:14:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:15:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:15:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:15:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:15:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:15:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:15:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:15:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:15:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:15:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:15:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:15:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:15:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-19 09:15:21 [DEBUG   ] Finished updating board flags in 2.233 seconds
2013-06-19 09:15:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:15:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:16:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:16:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:16:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:16:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:16:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:16:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:16:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:16:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:16:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:16:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:16:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:16:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-19 09:16:21 [DEBUG   ] Finished updating board flags in 2.203 seconds
2013-06-19 09:16:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:16:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 09:17:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 09:17:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:17:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:17:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:17:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:17:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:17:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:17:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:17:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:17:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:17:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:17:21 [DEBUG   ] Finished updating board flags in 2.155 seconds
2013-06-19 09:17:22 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 09:17:40 [DEBUG   ] Got command RPT from MCS: ref #12168
2013-06-19 09:17:40 [DEBUG   ] summary = ERROR
2013-06-19 09:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12168  13 56462 33460737 A  ERRORERROR'
2013-06-19 09:17:40 [DEBUG   ] Got command RPT from MCS: ref #12169
2013-06-19 09:17:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 09:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12169  98 56462 33460738 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 09:17:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 09:18:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 09:18:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:18:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:18:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:18:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:18:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:18:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:18:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:18:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:18:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:18:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:18:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 09:18:21 [DEBUG   ] Finished updating board flags in 2.058 seconds
2013-06-19 09:18:22 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 09:18:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 09:19:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 09:19:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:19:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:19:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:19:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:19:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:19:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:19:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:19:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:19:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:19:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:19:21 [DEBUG   ] Finished updating board flags in 2.024 seconds
2013-06-19 09:19:22 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 09:19:42 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 09:20:02 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-19 09:20:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:20:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:20:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:20:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:20:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:20:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:20:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:20:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:20:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:20:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:20:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 09:20:21 [DEBUG   ] Finished updating board flags in 1.926 seconds
2013-06-19 09:20:23 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-19 09:20:43 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 09:21:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:21:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:21:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:21:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:21:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:21:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:21:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:21:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:21:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:21:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:21:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:21:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 09:21:21 [DEBUG   ] Finished updating board flags in 1.808 seconds
2013-06-19 09:21:23 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 09:21:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:22:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 09:22:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:22:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:22:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:22:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:22:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:22:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:22:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:22:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:22:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:22:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:22:21 [DEBUG   ] Finished updating board flags in 1.825 seconds
2013-06-19 09:22:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:22:40 [DEBUG   ] Got command RPT from MCS: ref #12185
2013-06-19 09:22:40 [DEBUG   ] summary = ERROR
2013-06-19 09:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12185  13 56462 33760742 A  ERRORERROR'
2013-06-19 09:22:40 [DEBUG   ] Got command RPT from MCS: ref #12186
2013-06-19 09:22:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 09:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12186  98 56462 33760742 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 09:22:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:23:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:23:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:23:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:23:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:23:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:23:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:23:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:23:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:23:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:23:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:23:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:23:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 09:23:21 [DEBUG   ] Finished updating board flags in 1.828 seconds
2013-06-19 09:23:23 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 09:23:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:24:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:24:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:24:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:24:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:24:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:24:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:24:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:24:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 09:24:21 [DEBUG   ] Finished updating board flags in 1.737 seconds
2013-06-19 09:24:23 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 09:24:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:25:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:25:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:25:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:25:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:25:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:25:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:25:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:25:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:25:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:25:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:25:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:25:21 [DEBUG   ] Finished updating board flags in 1.662 seconds
2013-06-19 09:25:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:25:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:26:03 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 09:26:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:26:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:26:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:26:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:26:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:26:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:26:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:26:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:26:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:26:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:26:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 09:26:21 [DEBUG   ] Finished updating board flags in 1.632 seconds
2013-06-19 09:26:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:26:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 09:27:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 09:27:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:27:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:27:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:27:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:27:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:27:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:27:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:27:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:27:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:27:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:27:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 09:27:21 [DEBUG   ] Finished updating board flags in 1.506 seconds
2013-06-19 09:27:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 09:27:40 [DEBUG   ] Got command RPT from MCS: ref #12202
2013-06-19 09:27:40 [DEBUG   ] summary = ERROR
2013-06-19 09:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12202  13 56462 34060741 A  ERRORERROR'
2013-06-19 09:27:40 [DEBUG   ] Got command RPT from MCS: ref #12203
2013-06-19 09:27:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 09:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12203  98 56462 34060742 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 09:27:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 09:28:03 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 09:28:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:28:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:28:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:28:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:28:20 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:28:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:28:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:28:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:28:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:28:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:28:21 [DEBUG   ] Finished updating board flags in 1.517 seconds
2013-06-19 09:28:23 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 09:28:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 09:29:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:29:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:29:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:29:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:29:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:29:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:29:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:29:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:29:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:29:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:29:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:29:22 [DEBUG   ] Finished updating board flags in 2.358 seconds
2013-06-19 09:29:23 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 09:29:43 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 09:30:04 [DEBUG   ] Finished updating ant stats in 1.601 seconds
2013-06-19 09:30:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:30:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:30:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:30:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:30:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:30:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:30:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:30:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:30:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:30:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:30:22 [DEBUG   ] Finished updating board flags in 2.192 seconds
2013-06-19 09:30:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 09:30:44 [DEBUG   ] Finished updating ant stats in 1.601 seconds
2013-06-19 09:31:03 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 09:31:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:31:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:31:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:31:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:31:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:31:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:31:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:31:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:31:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:31:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:31:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 09:31:22 [DEBUG   ] Finished updating board flags in 1.955 seconds
2013-06-19 09:31:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 09:31:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 09:32:03 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 09:32:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:32:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:32:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:32:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:32:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:32:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:32:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:32:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:32:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:32:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:32:22 [DEBUG   ] Finished updating board flags in 1.815 seconds
2013-06-19 09:32:23 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 09:32:40 [DEBUG   ] Got command RPT from MCS: ref #12219
2013-06-19 09:32:40 [DEBUG   ] summary = ERROR
2013-06-19 09:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12219  13 56462 34360741 A  ERRORERROR'
2013-06-19 09:32:40 [DEBUG   ] Got command RPT from MCS: ref #12220
2013-06-19 09:32:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 09:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12220  98 56462 34360742 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 09:32:44 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-06-19 09:33:04 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-19 09:33:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:33:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:33:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:33:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:33:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:33:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:33:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:33:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:33:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:33:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:33:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 09:33:22 [DEBUG   ] Finished updating board flags in 1.770 seconds
2013-06-19 09:33:24 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 09:33:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:34:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:34:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:34:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:34:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:34:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:34:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:34:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:34:22 [DEBUG   ] Finished updating board flags in 1.618 seconds
2013-06-19 09:34:24 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 09:34:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 09:35:04 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 09:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:35:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:35:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:35:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:35:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:35:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:35:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:35:22 [DEBUG   ] Finished updating board flags in 1.615 seconds
2013-06-19 09:35:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 09:35:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 09:36:04 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-19 09:36:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:36:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:36:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:36:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:36:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:36:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:36:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:36:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:36:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:36:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:36:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 09:36:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 09:36:22 [DEBUG   ] Finished updating board flags in 1.568 seconds
2013-06-19 09:36:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:36:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:37:04 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 09:37:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:37:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:37:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:37:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:37:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:37:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:37:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:37:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:37:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:37:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:37:22 [DEBUG   ] Finished updating board flags in 1.453 seconds
2013-06-19 09:37:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 09:37:40 [DEBUG   ] Got command RPT from MCS: ref #12236
2013-06-19 09:37:40 [DEBUG   ] summary = ERROR
2013-06-19 09:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12236  13 56462 34660749 A  ERRORERROR'
2013-06-19 09:37:40 [DEBUG   ] Got command RPT from MCS: ref #12237
2013-06-19 09:37:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 09:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12237  98 56462 34660750 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 09:37:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 09:38:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 09:38:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:38:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:38:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:38:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:38:21 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:38:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:38:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:38:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:38:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:38:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:38:22 [DEBUG   ] Finished updating board flags in 1.605 seconds
2013-06-19 09:38:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 09:38:45 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-19 09:39:05 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-19 09:39:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:39:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:39:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:39:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:39:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:39:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:39:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:39:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:39:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:39:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:39:23 [DEBUG   ] Finished updating board flags in 2.515 seconds
2013-06-19 09:39:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 09:39:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:40:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:40:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:40:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:40:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:40:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:40:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:40:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:40:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:40:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:40:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:40:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:40:23 [DEBUG   ] Finished updating board flags in 2.229 seconds
2013-06-19 09:40:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:40:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 09:41:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 09:41:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:41:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:41:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:41:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:41:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:41:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:41:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:41:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:41:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:41:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:41:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 09:41:23 [DEBUG   ] Finished updating board flags in 2.251 seconds
2013-06-19 09:41:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:41:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:42:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:42:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:42:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:42:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:42:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:42:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:42:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:42:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:42:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:42:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:42:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:42:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 09:42:23 [DEBUG   ] Finished updating board flags in 2.178 seconds
2013-06-19 09:42:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 09:42:40 [DEBUG   ] Got command RPT from MCS: ref #12253
2013-06-19 09:42:40 [DEBUG   ] summary = ERROR
2013-06-19 09:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12253  13 56462 34960749 A  ERRORERROR'
2013-06-19 09:42:40 [DEBUG   ] Got command RPT from MCS: ref #12254
2013-06-19 09:42:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 09:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12254  98 56462 34960750 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 09:42:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:43:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:43:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:43:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:43:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:43:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:43:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:43:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:43:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:43:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:43:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:43:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:43:23 [DEBUG   ] Finished updating board flags in 2.044 seconds
2013-06-19 09:43:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 09:43:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 09:44:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:44:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:44:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:44:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:44:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:44:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:44:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:44:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:44:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:44:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:44:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:44:23 [DEBUG   ] Finished updating board flags in 2.018 seconds
2013-06-19 09:44:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:44:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 09:45:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:45:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:45:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:45:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:45:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:45:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:45:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:45:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:45:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:45:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:45:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:45:23 [DEBUG   ] Finished updating board flags in 1.952 seconds
2013-06-19 09:45:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:45:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:46:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:46:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:46:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:46:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:46:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:46:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:46:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:46:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:46:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:46:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:46:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:46:23 [DEBUG   ] Finished updating board flags in 1.853 seconds
2013-06-19 09:46:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 09:46:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:47:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:47:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:47:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:47:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:47:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:47:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:47:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:47:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:47:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:47:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:47:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:47:23 [DEBUG   ] Finished updating board flags in 1.737 seconds
2013-06-19 09:47:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 09:47:40 [DEBUG   ] Got command RPT from MCS: ref #12270
2013-06-19 09:47:40 [DEBUG   ] summary = ERROR
2013-06-19 09:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12270  13 56462 35260746 A  ERRORERROR'
2013-06-19 09:47:40 [DEBUG   ] Got command RPT from MCS: ref #12271
2013-06-19 09:47:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 09:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12271  98 56462 35260746 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 09:47:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 09:48:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 09:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:48:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:48:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:48:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:48:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:48:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:48:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:48:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 09:48:23 [DEBUG   ] Finished updating board flags in 1.622 seconds
2013-06-19 09:48:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 09:48:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 09:49:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 09:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:49:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:49:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:49:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:49:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:49:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:49:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:49:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 09:49:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 09:49:23 [DEBUG   ] Finished updating board flags in 1.643 seconds
2013-06-19 09:49:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 09:49:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 09:50:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 09:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:50:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:50:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:50:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 09:50:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 09:50:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 09:50:23 [DEBUG   ] Finished updating board flags in 1.612 seconds
2013-06-19 09:50:25 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2013-06-19 09:50:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:51:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:51:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:51:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:51:23 [DEBUG   ] Finished updating board flags in 1.509 seconds
2013-06-19 09:51:25 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 09:51:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 09:52:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:52:22 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:52:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:52:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:52:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:52:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:52:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:52:23 [DEBUG   ] Finished updating board flags in 1.486 seconds
2013-06-19 09:52:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:52:40 [DEBUG   ] Got command RPT from MCS: ref #12287
2013-06-19 09:52:40 [DEBUG   ] summary = ERROR
2013-06-19 09:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12287  13 56462 35560753 A  ERRORERROR'
2013-06-19 09:52:40 [DEBUG   ] Got command RPT from MCS: ref #12288
2013-06-19 09:52:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 09:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12288  98 56462 35560754 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 09:52:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 09:53:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 09:53:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:53:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:53:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:53:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:53:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:53:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:53:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:53:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:53:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:53:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:53:24 [DEBUG   ] Finished updating board flags in 2.399 seconds
2013-06-19 09:53:25 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-19 09:53:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 09:54:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 09:54:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:54:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:54:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:54:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:54:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:54:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:54:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:54:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:54:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:54:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:54:24 [DEBUG   ] Finished updating board flags in 2.222 seconds
2013-06-19 09:54:25 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2013-06-19 09:54:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 09:55:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 09:55:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:55:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:55:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:55:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:55:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:55:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:55:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:55:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:55:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:55:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:55:24 [DEBUG   ] Finished updating board flags in 2.109 seconds
2013-06-19 09:55:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 09:55:45 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 09:56:05 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-19 09:56:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:56:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:56:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:56:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:56:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:56:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:56:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:56:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:56:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:56:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:56:24 [DEBUG   ] Finished updating board flags in 2.024 seconds
2013-06-19 09:56:26 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-19 09:56:46 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 09:57:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:57:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:57:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:57:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:57:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:57:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:57:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:57:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 09:57:24 [DEBUG   ] Finished updating board flags in 1.975 seconds
2013-06-19 09:57:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:57:40 [DEBUG   ] Got command RPT from MCS: ref #12304
2013-06-19 09:57:40 [DEBUG   ] summary = ERROR
2013-06-19 09:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12304  13 56462 35860753 A  ERRORERROR'
2013-06-19 09:57:40 [DEBUG   ] Got command RPT from MCS: ref #12305
2013-06-19 09:57:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 09:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12305  98 56462 35860754 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 09:57:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 09:58:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 09:58:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:58:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:58:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:58:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:58:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:58:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:58:24 [DEBUG   ] Finished updating board flags in 1.865 seconds
2013-06-19 09:58:26 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 09:58:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 09:59:06 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 09:59:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 09:59:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 09:59:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 09:59:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 09:59:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 09:59:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 09:59:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 09:59:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 09:59:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 09:59:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 09:59:24 [DEBUG   ] Finished updating board flags in 1.736 seconds
2013-06-19 09:59:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 09:59:46 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 10:00:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 10:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:00:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:00:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:00:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:00:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:00:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:00:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:00:24 [DEBUG   ] Finished updating board flags in 1.617 seconds
2013-06-19 10:00:26 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 10:00:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 10:01:06 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-19 10:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:01:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:01:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:01:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:01:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:01:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:01:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:01:24 [DEBUG   ] Finished updating board flags in 1.587 seconds
2013-06-19 10:01:26 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2013-06-19 10:01:47 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-19 10:02:07 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-19 10:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:02:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:02:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:02:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:02:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:02:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:02:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:02:24 [DEBUG   ] Finished updating board flags in 1.415 seconds
2013-06-19 10:02:27 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 10:02:40 [DEBUG   ] Got command RPT from MCS: ref #12321
2013-06-19 10:02:40 [DEBUG   ] summary = ERROR
2013-06-19 10:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12321  13 56462 36160753 A  ERRORERROR'
2013-06-19 10:02:40 [DEBUG   ] Got command RPT from MCS: ref #12322
2013-06-19 10:02:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 10:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12322  98 56462 36160754 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 10:02:47 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2013-06-19 10:03:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 10:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:03:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:03:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:03:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:03:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:03:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:03:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:03:24 [DEBUG   ] Finished updating board flags in 1.403 seconds
2013-06-19 10:03:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 10:03:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 10:04:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 10:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:04:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:04:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:04:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:04:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:04:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:04:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:04:24 [DEBUG   ] Finished updating board flags in 1.419 seconds
2013-06-19 10:04:27 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 10:04:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 10:05:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 10:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:05:23 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:05:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:05:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:05:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:05:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:05:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:05:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 10:05:24 [DEBUG   ] Finished updating board flags in 1.369 seconds
2013-06-19 10:05:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 10:05:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 10:06:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 10:06:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:06:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:06:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:06:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:06:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:06:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:06:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:06:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:06:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:06:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:06:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 10:06:25 [DEBUG   ] Finished updating board flags in 2.218 seconds
2013-06-19 10:06:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 10:06:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 10:07:07 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 10:07:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:07:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:07:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:07:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:07:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:07:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:07:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:07:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:07:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:07:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:07:25 [DEBUG   ] Finished updating board flags in 2.194 seconds
2013-06-19 10:07:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 10:07:40 [DEBUG   ] Got command RPT from MCS: ref #12338
2013-06-19 10:07:40 [DEBUG   ] summary = ERROR
2013-06-19 10:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12338  13 56462 36460753 A  ERRORERROR'
2013-06-19 10:07:40 [DEBUG   ] Got command RPT from MCS: ref #12339
2013-06-19 10:07:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 10:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12339  98 56462 36460754 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 10:07:47 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 10:08:08 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-19 10:08:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:08:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:08:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:08:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:08:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:08:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:08:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:08:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:08:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:08:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:08:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 10:08:25 [DEBUG   ] Finished updating board flags in 2.011 seconds
2013-06-19 10:08:28 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-19 10:08:48 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 10:09:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 10:09:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:09:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:09:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:09:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:09:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:09:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:09:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 10:09:25 [DEBUG   ] Finished updating board flags in 2.005 seconds
2013-06-19 10:09:28 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 10:09:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 10:10:08 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 10:10:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:10:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:10:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:10:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:10:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:10:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:10:25 [DEBUG   ] Finished updating board flags in 2.011 seconds
2013-06-19 10:10:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 10:10:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 10:11:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 10:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:11:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:11:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:11:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:11:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:11:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:11:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:11:25 [DEBUG   ] Finished updating board flags in 1.980 seconds
2013-06-19 10:11:28 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2013-06-19 10:11:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 10:12:09 [DEBUG   ] Finished updating ant stats in 1.601 seconds
2013-06-19 10:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:12:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:12:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:12:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:12:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:12:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:12:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:12:25 [DEBUG   ] Finished updating board flags in 1.817 seconds
2013-06-19 10:12:28 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 10:12:40 [DEBUG   ] Got command RPT from MCS: ref #12355
2013-06-19 10:12:40 [DEBUG   ] summary = ERROR
2013-06-19 10:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12355  13 56462 36760757 A  ERRORERROR'
2013-06-19 10:12:40 [DEBUG   ] Got command RPT from MCS: ref #12356
2013-06-19 10:12:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 10:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12356  98 56462 36760758 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 10:12:49 [DEBUG   ] Finished updating ant stats in 1.600 seconds
2013-06-19 10:13:08 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 10:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:13:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:13:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:13:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:13:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:13:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:13:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:13:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 10:13:25 [DEBUG   ] Finished updating board flags in 1.908 seconds
2013-06-19 10:13:28 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-19 10:13:48 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2013-06-19 10:14:09 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-19 10:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:14:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:14:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:14:25 [DEBUG   ] Finished updating board flags in 1.677 seconds
2013-06-19 10:14:29 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-19 10:14:49 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 10:15:09 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 10:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:15:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:15:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:15:25 [DEBUG   ] Finished updating board flags in 1.619 seconds
2013-06-19 10:15:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 10:15:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 10:16:09 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 10:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:16:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:16:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-19 10:16:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:16:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:16:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:16:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:16:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:16:25 [DEBUG   ] Finished updating board flags in 1.579 seconds
2013-06-19 10:16:29 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2013-06-19 10:16:49 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 10:17:09 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-19 10:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:17:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:17:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:17:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:17:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:17:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:17:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:17:25 [DEBUG   ] Finished updating board flags in 1.428 seconds
2013-06-19 10:17:29 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 10:17:40 [DEBUG   ] Got command RPT from MCS: ref #12372
2013-06-19 10:17:40 [DEBUG   ] summary = ERROR
2013-06-19 10:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12372  13 56462 37060757 A  ERRORERROR'
2013-06-19 10:17:40 [DEBUG   ] Got command RPT from MCS: ref #12373
2013-06-19 10:17:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 10:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12373  98 56462 37060758 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 10:17:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 10:18:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 10:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:18:24 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:18:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:18:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:18:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:18:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:18:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:18:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 10:18:25 [DEBUG   ] Finished updating board flags in 1.398 seconds
2013-06-19 10:18:30 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2013-06-19 10:18:49 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-19 10:19:10 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-19 10:19:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:19:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:19:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:19:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:19:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:19:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:19:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:19:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:19:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:19:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:19:26 [DEBUG   ] Finished updating board flags in 2.207 seconds
2013-06-19 10:19:30 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-19 10:19:50 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 10:20:10 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 10:20:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:20:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:20:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:20:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:20:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:20:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:20:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:20:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:20:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:20:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:20:26 [DEBUG   ] Finished updating board flags in 2.180 seconds
2013-06-19 10:20:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 10:20:50 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 10:21:10 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 10:21:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:21:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:21:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:21:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:21:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:21:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:21:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:21:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:21:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:21:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:21:26 [DEBUG   ] Finished updating board flags in 2.020 seconds
2013-06-19 10:21:30 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 10:21:50 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 10:22:10 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 10:22:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:22:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:22:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:22:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:22:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:22:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:22:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:22:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:22:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:22:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:22:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 10:22:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 10:22:26 [DEBUG   ] Finished updating board flags in 1.990 seconds
2013-06-19 10:22:30 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2013-06-19 10:22:40 [DEBUG   ] Got command RPT from MCS: ref #12389
2013-06-19 10:22:40 [DEBUG   ] summary = ERROR
2013-06-19 10:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12389  13 56462 37360761 A  ERRORERROR'
2013-06-19 10:22:40 [DEBUG   ] Got command RPT from MCS: ref #12390
2013-06-19 10:22:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 10:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12390  98 56462 37360762 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 10:22:50 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 10:23:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 10:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:23:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:23:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:23:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:23:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:23:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:23:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:23:26 [DEBUG   ] Finished updating board flags in 1.813 seconds
2013-06-19 10:23:30 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-19 10:23:51 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-19 10:24:11 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 10:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:24:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:24:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:24:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:24:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:24:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:24:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:24:26 [DEBUG   ] Finished updating board flags in 1.788 seconds
2013-06-19 10:24:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 10:24:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 10:25:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 10:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:25:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:25:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:25:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:25:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:25:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:25:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:25:26 [DEBUG   ] Finished updating board flags in 1.606 seconds
2013-06-19 10:25:31 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 10:25:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 10:26:11 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 10:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:26:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:26:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:26:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:26:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:26:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:26:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:26:26 [DEBUG   ] Finished updating board flags in 1.612 seconds
2013-06-19 10:26:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 10:26:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 10:27:11 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 10:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:27:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:27:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:27:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:27:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:27:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:27:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:27:26 [DEBUG   ] Finished updating board flags in 1.585 seconds
2013-06-19 10:27:31 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 10:27:40 [DEBUG   ] Got command RPT from MCS: ref #12406
2013-06-19 10:27:40 [DEBUG   ] summary = ERROR
2013-06-19 10:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12406  13 56462 37660753 A  ERRORERROR'
2013-06-19 10:27:40 [DEBUG   ] Got command RPT from MCS: ref #12407
2013-06-19 10:27:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 10:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12407  98 56462 37660754 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 10:27:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 10:28:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 10:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:28:25 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:28:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:28:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:28:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:28:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:28:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:28:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 10:28:26 [DEBUG   ] Finished updating board flags in 1.558 seconds
2013-06-19 10:28:32 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-19 10:28:52 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 10:29:12 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 10:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:29:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:29:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:29:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:29:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:29:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:29:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:29:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 10:29:27 [DEBUG   ] Finished updating board flags in 2.350 seconds
2013-06-19 10:29:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 10:29:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 10:30:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 10:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:30:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:30:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:30:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:30:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:30:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:30:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:30:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-19 10:30:27 [DEBUG   ] Finished updating board flags in 2.110 seconds
2013-06-19 10:30:32 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 10:30:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 10:31:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 10:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:31:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:31:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:31:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:31:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:31:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:31:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:31:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 3
2013-06-19 10:31:27 [DEBUG   ] Finished updating board flags in 2.015 seconds
2013-06-19 10:31:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 10:31:52 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 10:32:12 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-19 10:32:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:32:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:32:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:32:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:32:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:32:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:32:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:32:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:32:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:32:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:32:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 10:32:27 [DEBUG   ] Finished updating board flags in 1.985 seconds
2013-06-19 10:32:32 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 10:32:40 [DEBUG   ] Got command RPT from MCS: ref #12423
2013-06-19 10:32:40 [DEBUG   ] summary = ERROR
2013-06-19 10:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12423  13 56462 37960761 A  ERRORERROR'
2013-06-19 10:32:40 [DEBUG   ] Got command RPT from MCS: ref #12424
2013-06-19 10:32:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 10:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12424  98 56462 37960762 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 10:32:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 10:33:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 10:33:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:33:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:33:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:33:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:33:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:33:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:33:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:33:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:33:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:33:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:33:27 [DEBUG   ] Finished updating board flags in 1.809 seconds
2013-06-19 10:33:33 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-19 10:33:53 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 10:34:13 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 10:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:34:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:34:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:34:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:34:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:34:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:34:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:34:27 [DEBUG   ] Finished updating board flags in 1.798 seconds
2013-06-19 10:34:33 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2013-06-19 10:34:53 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 10:35:13 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 10:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:35:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:35:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:35:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:35:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:35:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:35:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:35:27 [DEBUG   ] Finished updating board flags in 1.596 seconds
2013-06-19 10:35:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 10:35:53 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-06-19 10:36:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 10:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:36:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:36:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:36:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:36:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:36:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:36:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:36:27 [DEBUG   ] Finished updating board flags in 1.417 seconds
2013-06-19 10:36:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 10:36:53 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 10:37:14 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-19 10:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:37:26 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:37:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:37:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 10:37:27 [DEBUG   ] Finished updating board flags in 1.382 seconds
2013-06-19 10:37:34 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 10:37:40 [DEBUG   ] Got command RPT from MCS: ref #12440
2013-06-19 10:37:40 [DEBUG   ] summary = ERROR
2013-06-19 10:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12440  13 56462 38260761 A  ERRORERROR'
2013-06-19 10:37:40 [DEBUG   ] Got command RPT from MCS: ref #12441
2013-06-19 10:37:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 10:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12441  98 56462 38260762 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 10:37:54 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-19 10:38:14 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 10:38:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:38:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:38:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:38:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:38:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:38:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:38:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:38:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:38:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:38:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:38:28 [DEBUG   ] Finished updating board flags in 2.219 seconds
2013-06-19 10:38:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 10:38:54 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 10:39:14 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 10:39:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:39:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:39:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:39:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:39:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:39:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:39:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:39:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:39:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:39:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:39:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 10:39:28 [DEBUG   ] Finished updating board flags in 2.187 seconds
2013-06-19 10:39:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 10:39:54 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 10:40:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 10:40:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:40:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:40:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:40:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:40:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:40:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:40:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:40:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:40:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:40:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:40:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 10:40:28 [DEBUG   ] Finished updating board flags in 2.015 seconds
2013-06-19 10:40:34 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-19 10:40:54 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 10:41:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 10:41:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:41:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:41:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:41:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:41:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:41:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:41:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:41:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:41:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:41:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:41:28 [DEBUG   ] Finished updating board flags in 2.009 seconds
2013-06-19 10:41:35 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-19 10:41:55 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 10:42:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 10:42:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:42:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:42:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:42:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:42:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:42:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:42:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:42:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:42:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:42:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:42:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 10:42:28 [DEBUG   ] Finished updating board flags in 1.992 seconds
2013-06-19 10:42:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 10:42:40 [DEBUG   ] Got command RPT from MCS: ref #12457
2013-06-19 10:42:40 [DEBUG   ] summary = ERROR
2013-06-19 10:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12457  13 56462 38560765 A  ERRORERROR'
2013-06-19 10:42:40 [DEBUG   ] Got command RPT from MCS: ref #12458
2013-06-19 10:42:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 10:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12458  98 56462 38560766 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 10:42:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2013-06-19 10:43:15 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 10:43:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:43:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:43:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:43:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:43:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:43:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:43:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:43:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:43:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:43:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:43:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 10:43:28 [DEBUG   ] Finished updating board flags in 1.823 seconds
2013-06-19 10:43:35 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 10:43:55 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 10:44:15 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 10:44:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:44:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:44:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:44:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:44:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:44:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:44:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:44:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:44:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:44:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:44:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 10:44:28 [DEBUG   ] Finished updating board flags in 1.783 seconds
2013-06-19 10:44:35 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 10:44:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 10:45:15 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 10:45:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:45:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:45:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:45:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:45:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:45:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:45:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:45:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:45:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:45:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:45:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 10:45:28 [DEBUG   ] Finished updating board flags in 1.594 seconds
2013-06-19 10:45:35 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 10:45:55 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 10:46:15 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 10:46:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:46:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:46:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:46:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:46:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:46:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:46:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:46:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:46:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:46:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:46:28 [DEBUG   ] Finished updating board flags in 1.445 seconds
2013-06-19 10:46:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 10:46:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 10:47:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 10:47:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:47:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:47:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:47:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:47:27 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:47:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:47:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:47:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:47:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:47:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:47:28 [DEBUG   ] Finished updating board flags in 1.365 seconds
2013-06-19 10:47:36 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-19 10:47:40 [DEBUG   ] Got command RPT from MCS: ref #12474
2013-06-19 10:47:40 [DEBUG   ] summary = ERROR
2013-06-19 10:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12474  13 56462 38860765 A  ERRORERROR'
2013-06-19 10:47:40 [DEBUG   ] Got command RPT from MCS: ref #12475
2013-06-19 10:47:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 10:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12475  98 56462 38860766 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 10:47:56 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 10:48:16 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2013-06-19 10:48:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:48:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:48:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:48:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:48:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:48:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:48:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:48:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:48:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:48:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:48:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 10:48:29 [DEBUG   ] Finished updating board flags in 2.217 seconds
2013-06-19 10:48:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 10:48:56 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 10:49:16 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 10:49:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:49:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:49:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:49:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:49:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:49:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:49:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:49:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:49:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:49:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:49:29 [DEBUG   ] Finished updating board flags in 2.181 seconds
2013-06-19 10:49:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 10:49:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 10:50:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 10:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:50:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:50:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:50:29 [DEBUG   ] Finished updating board flags in 2.013 seconds
2013-06-19 10:50:36 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 10:50:56 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 10:51:16 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 10:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:51:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:51:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:51:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 10:51:29 [DEBUG   ] Finished updating board flags in 1.978 seconds
2013-06-19 10:51:37 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-19 10:51:57 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 10:52:17 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 10:52:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:52:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:52:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:52:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:52:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:52:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:52:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:52:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:52:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:52:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:52:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 10:52:29 [DEBUG   ] Finished updating board flags in 1.827 seconds
2013-06-19 10:52:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 10:52:40 [DEBUG   ] Got command RPT from MCS: ref #12491
2013-06-19 10:52:40 [DEBUG   ] summary = ERROR
2013-06-19 10:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12491  13 56462 39160765 A  ERRORERROR'
2013-06-19 10:52:40 [DEBUG   ] Got command RPT from MCS: ref #12492
2013-06-19 10:52:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 10:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12492  98 56462 39160766 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 10:52:57 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 10:53:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 10:53:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:53:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:53:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:53:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:53:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:53:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:53:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:53:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:53:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:53:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:53:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-19 10:53:29 [DEBUG   ] Finished updating board flags in 1.789 seconds
2013-06-19 10:53:37 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 10:53:57 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2013-06-19 10:54:17 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 10:54:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:54:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:54:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:54:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:54:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:54:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:54:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:54:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:54:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:54:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:54:29 [DEBUG   ] Finished updating board flags in 1.609 seconds
2013-06-19 10:54:37 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 10:54:57 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 10:55:17 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 10:55:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:55:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:55:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:55:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:55:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:55:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:55:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:55:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:55:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:55:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:55:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 10:55:29 [DEBUG   ] Finished updating board flags in 1.591 seconds
2013-06-19 10:55:37 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-19 10:55:58 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-19 10:56:18 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2013-06-19 10:56:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:56:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:56:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:56:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:56:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:56:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:56:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:56:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:56:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:56:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:56:29 [DEBUG   ] Finished updating board flags in 1.419 seconds
2013-06-19 10:56:38 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 10:56:58 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 10:57:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 10:57:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:57:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:57:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:57:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:57:28 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:57:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:57:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:57:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:57:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:57:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:57:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 10:57:29 [DEBUG   ] Finished updating board flags in 1.390 seconds
2013-06-19 10:57:38 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 10:57:40 [DEBUG   ] Got command RPT from MCS: ref #12508
2013-06-19 10:57:40 [DEBUG   ] summary = ERROR
2013-06-19 10:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12508  13 56462 39460757 A  ERRORERROR'
2013-06-19 10:57:40 [DEBUG   ] Got command RPT from MCS: ref #12509
2013-06-19 10:57:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 10:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12509  98 56462 39460758 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 10:57:58 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 10:58:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 10:58:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:58:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:58:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:58:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:58:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:58:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:58:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:58:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:58:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:58:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:58:30 [DEBUG   ] Finished updating board flags in 2.235 seconds
2013-06-19 10:58:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 10:58:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 10:59:18 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 10:59:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 10:59:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 10:59:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 10:59:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 10:59:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 10:59:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 10:59:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 10:59:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 10:59:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 10:59:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 10:59:30 [DEBUG   ] Finished updating board flags in 2.165 seconds
2013-06-19 10:59:38 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 10:59:58 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 11:00:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 11:00:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 11:00:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 11:00:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 11:00:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 11:00:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 11:00:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 11:00:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 11:00:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 11:00:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 11:00:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 11:00:30 [DEBUG   ] Finished updating board flags in 2.014 seconds
2013-06-19 11:00:38 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2013-06-19 11:00:59 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-19 11:01:19 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 11:01:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 11:01:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 11:01:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 11:01:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 11:01:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 11:01:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 11:01:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 11:01:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 11:01:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 11:01:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 11:01:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-19 11:01:30 [DEBUG   ] Finished updating board flags in 1.993 seconds
2013-06-19 11:01:39 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 11:01:59 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 11:02:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 11:02:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 11:02:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 11:02:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 11:02:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 11:02:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 11:02:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 11:02:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 11:02:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 11:02:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 11:02:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 11:02:30 [DEBUG   ] Finished updating board flags in 1.814 seconds
2013-06-19 11:02:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 11:02:40 [DEBUG   ] Got command RPT from MCS: ref #12525
2013-06-19 11:02:40 [DEBUG   ] summary = ERROR
2013-06-19 11:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12525  13 56462 39760761 A  ERRORERROR'
2013-06-19 11:02:40 [DEBUG   ] Got command RPT from MCS: ref #12526
2013-06-19 11:02:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 11:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12526  98 56462 39760762 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 11:02:59 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 11:03:19 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 11:03:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 11:03:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 11:03:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 11:03:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 11:03:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 11:03:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 11:03:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 11:03:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 11:03:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 11:03:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 11:03:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 11:03:30 [DEBUG   ] Finished updating board flags in 1.780 seconds
2013-06-19 11:03:39 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 11:03:59 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 11:04:19 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 11:04:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 11:04:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 11:04:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 11:04:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 11:04:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 11:04:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 11:04:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 11:04:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 11:04:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 11:04:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 11:04:30 [DEBUG   ] Finished updating board flags in 1.617 seconds
2013-06-19 11:04:39 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 11:04:59 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 11:05:19 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2013-06-19 11:05:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 11:05:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 11:05:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 11:05:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 11:05:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 11:05:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 11:05:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 11:05:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 11:05:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 11:05:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 11:05:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 11:05:30 [DEBUG   ] Finished updating board flags in 1.609 seconds
2013-06-19 11:05:40 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2013-06-19 11:06:00 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-19 11:06:20 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 11:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 11:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 11:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 11:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 11:06:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 11:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 11:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 11:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 11:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 11:06:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 11:06:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 11:06:30 [DEBUG   ] Finished updating board flags in 1.580 seconds
2013-06-19 11:06:40 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2013-06-19 11:07:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 11:07:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 11:07:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 11:07:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 11:07:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 11:07:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 11:07:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 11:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 11:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 11:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 11:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 11:07:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 11:07:30 [DEBUG   ] Finished updating board flags in 1.421 seconds
2013-06-19 11:07:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 11:07:40 [DEBUG   ] Got command RPT from MCS: ref #12542
2013-06-19 11:07:40 [DEBUG   ] summary = ERROR
2013-06-19 11:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12542  13 56462 40060765 A  ERRORERROR'
2013-06-19 11:07:40 [DEBUG   ] Got command RPT from MCS: ref #12543
2013-06-19 11:07:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 11:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12543  98 56462 40060766 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 11:08:00 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 11:08:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 11:08:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 11:08:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 11:08:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 11:08:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 11:08:29 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 11:08:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 11:08:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 11:08:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 11:08:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 11:08:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 11:08:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 11:08:30 [DEBUG   ] Finished updating board flags in 1.377 seconds
2013-06-19 11:08:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 11:09:00 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 11:09:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 11:09:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 11:09:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 11:09:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 11:09:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 11:09:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 11:09:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 11:09:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 11:09:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 11:09:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 11:09:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 11:09:31 [DEBUG   ] Finished updating board flags in 2.266 seconds
2013-06-19 11:09:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 11:10:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 11:10:20 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 11:10:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 11:10:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 11:10:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 11:10:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 11:10:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 11:10:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 11:10:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 11:10:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 11:10:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 11:10:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 11:10:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 11:10:31 [DEBUG   ] Finished updating board flags in 2.145 seconds
2013-06-19 11:10:40 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 11:11:01 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-19 11:11:21 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 11:11:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 11:11:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 11:11:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 11:11:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 11:11:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 11:11:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 11:11:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 11:11:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 11:11:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 11:11:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 11:11:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 11:11:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 11:11:31 [DEBUG   ] Finished updating board flags in 2.006 seconds
2013-06-19 11:11:41 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 11:12:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2013-06-19 11:12:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 11:12:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 11:12:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 11:12:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 11:12:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 11:12:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 11:12:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 11:12:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 11:12:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 11:12:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 11:12:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 11:12:31 [DEBUG   ] Finished updating board flags in 2.008 seconds
2013-06-19 11:12:40 [DEBUG   ] Got command RPT from MCS: ref #12559
2013-06-19 11:12:40 [DEBUG   ] summary = ERROR
2013-06-19 11:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12559  13 56462 40360769 A  ERRORERROR'
2013-06-19 11:12:40 [DEBUG   ] Got command RPT from MCS: ref #12560
2013-06-19 11:12:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 11:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12560  98 56462 40360770 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 11:12:41 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 11:13:01 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2013-06-19 11:13:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 11:13:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 11:13:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 11:13:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 11:13:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 11:13:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 11:13:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 11:13:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 11:13:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 11:13:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 11:13:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 11:13:31 [DEBUG   ] Finished updating board flags in 1.982 seconds
2013-06-19 11:13:41 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 11:14:01 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 11:14:21 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 11:14:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 11:14:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 11:14:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 11:14:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 11:14:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 11:14:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 11:14:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 11:14:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 11:14:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 11:14:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 11:14:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 11:14:31 [DEBUG   ] Finished updating board flags in 1.809 seconds
2013-06-19 11:14:41 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 11:15:02 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-19 11:15:21 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 11:15:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 11:15:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 11:15:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 11:15:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 11:15:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 11:15:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 11:15:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 11:15:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 11:15:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 11:15:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 11:15:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 11:15:31 [DEBUG   ] Finished updating board flags in 1.808 seconds
2013-06-19 11:15:42 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2013-06-19 11:16:02 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 11:16:22 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 11:16:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 11:16:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 11:16:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 11:16:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 11:16:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 11:16:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 11:16:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 11:16:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 11:16:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 11:16:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 11:16:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 11:16:31 [DEBUG   ] Finished updating board flags in 1.784 seconds
2013-06-19 11:16:42 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 11:17:03 [DEBUG   ] Finished updating ant stats in 1.997 seconds
2013-06-19 11:17:22 [DEBUG   ] Finished updating ant stats in 0.808 seconds
2013-06-19 11:17:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714618
2013-06-19 11:17:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714296
2013-06-19 11:17:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714550
2013-06-19 11:17:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713845
2013-06-19 11:17:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714357
2013-06-19 11:17:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546141
2013-06-19 11:17:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546134
2013-06-19 11:17:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546273
2013-06-19 11:17:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546304
2013-06-19 11:17:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546151
2013-06-19 11:17:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 11:17:31 [DEBUG   ] Finished updating board flags in 1.615 seconds
2013-06-19 11:17:40 [DEBUG   ] Got command RPT from MCS: ref #12576
2013-06-19 11:17:40 [DEBUG   ] summary = ERROR
2013-06-19 11:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12576  13 56462 40660762 A  ERRORERROR'
2013-06-19 11:17:40 [DEBUG   ] Got command RPT from MCS: ref #12577
2013-06-19 11:17:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 11:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12577  98 56462 40660762 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 11:17:42 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 11:18:02 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 11:18:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714520
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714198
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714452
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713747
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714259
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-19 11:18:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546043
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546036
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546175
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546206
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546053
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-19 11:18:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-19 11:18:31 [DEBUG   ] Finished updating board flags in 1.621 seconds
2013-06-19 11:18:43 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-19 11:19:03 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 11:19:23 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714520
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714198
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714452
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713747
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714259
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-19 11:19:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546043
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546036
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546175
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546206
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546053
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-19 11:19:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-19 11:19:31 [DEBUG   ] Finished updating board flags in 1.583 seconds
2013-06-19 11:19:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 11:20:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 11:20:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 11:20:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714520
2013-06-19 11:20:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714198
2013-06-19 11:20:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714452
2013-06-19 11:20:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713747
2013-06-19 11:20:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714259
2013-06-19 11:20:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546043
2013-06-19 11:20:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546036
2013-06-19 11:20:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546175
2013-06-19 11:20:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546206
2013-06-19 11:20:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546053
2013-06-19 11:20:31 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 11:20:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 11:20:31 [DEBUG   ] Finished updating board flags in 1.408 seconds
2013-06-19 11:20:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 11:21:03 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2013-06-19 11:21:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 11:21:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714520
2013-06-19 11:21:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714198
2013-06-19 11:21:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714452
2013-06-19 11:21:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713747
2013-06-19 11:21:30 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714259
2013-06-19 11:21:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546043
2013-06-19 11:21:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546036
2013-06-19 11:21:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546175
2013-06-19 11:21:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546206
2013-06-19 11:21:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546053
2013-06-19 11:21:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-19 11:21:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 11:21:31 [DEBUG   ] Finished updating board flags in 1.395 seconds
2013-06-19 11:21:44 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-19 11:22:04 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 11:22:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 11:22:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714520
2013-06-19 11:22:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714198
2013-06-19 11:22:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714452
2013-06-19 11:22:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713747
2013-06-19 11:22:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714259
2013-06-19 11:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546043
2013-06-19 11:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546036
2013-06-19 11:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546175
2013-06-19 11:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546206
2013-06-19 11:22:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546053
2013-06-19 11:22:32 [DEBUG   ] Finished updating board flags in 2.204 seconds
2013-06-19 11:22:40 [DEBUG   ] Got command RPT from MCS: ref #12593
2013-06-19 11:22:40 [DEBUG   ] summary = ERROR
2013-06-19 11:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12593  13 56462 40960769 A  ERRORERROR'
2013-06-19 11:22:40 [DEBUG   ] Got command RPT from MCS: ref #12594
2013-06-19 11:22:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 11:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12594  98 56462 40960770 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 11:22:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 11:23:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 11:23:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 11:23:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714520
2013-06-19 11:23:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714198
2013-06-19 11:23:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714452
2013-06-19 11:23:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713747
2013-06-19 11:23:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714259
2013-06-19 11:23:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546043
2013-06-19 11:23:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546036
2013-06-19 11:23:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546175
2013-06-19 11:23:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546206
2013-06-19 11:23:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546053
2013-06-19 11:23:32 [DEBUG   ] Finished updating board flags in 2.194 seconds
2013-06-19 11:23:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 11:24:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 11:24:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 11:24:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714520
2013-06-19 11:24:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714198
2013-06-19 11:24:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714452
2013-06-19 11:24:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713747
2013-06-19 11:24:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714259
2013-06-19 11:24:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546043
2013-06-19 11:24:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546036
2013-06-19 11:24:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546175
2013-06-19 11:24:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546206
2013-06-19 11:24:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546053
2013-06-19 11:24:32 [DEBUG   ] Finished updating board flags in 2.015 seconds
2013-06-19 11:24:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2013-06-19 11:25:04 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 11:25:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 11:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714520
2013-06-19 11:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714198
2013-06-19 11:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714452
2013-06-19 11:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713747
2013-06-19 11:25:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714259
2013-06-19 11:25:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546043
2013-06-19 11:25:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546036
2013-06-19 11:25:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546175
2013-06-19 11:25:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546206
2013-06-19 11:25:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546053
2013-06-19 11:25:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 11:25:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 11:25:32 [DEBUG   ] Finished updating board flags in 1.998 seconds
2013-06-19 11:25:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 11:26:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2013-06-19 11:26:24 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 11:26:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714520
2013-06-19 11:26:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714198
2013-06-19 11:26:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714452
2013-06-19 11:26:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713747
2013-06-19 11:26:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714259
2013-06-19 11:26:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546043
2013-06-19 11:26:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546036
2013-06-19 11:26:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546175
2013-06-19 11:26:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546206
2013-06-19 11:26:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546053
2013-06-19 11:26:32 [DEBUG   ] Finished updating board flags in 1.816 seconds
2013-06-19 11:26:45 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-19 11:27:05 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 11:27:25 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 11:27:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714520
2013-06-19 11:27:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714198
2013-06-19 11:27:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714452
2013-06-19 11:27:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713747
2013-06-19 11:27:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714259
2013-06-19 11:27:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546043
2013-06-19 11:27:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546036
2013-06-19 11:27:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546175
2013-06-19 11:27:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546206
2013-06-19 11:27:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546053
2013-06-19 11:27:32 [DEBUG   ] Finished updating board flags in 1.786 seconds
2013-06-19 11:27:40 [DEBUG   ] Got command RPT from MCS: ref #12610
2013-06-19 11:27:40 [DEBUG   ] summary = ERROR
2013-06-19 11:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12610  13 56462 41260773 A  ERRORERROR'
2013-06-19 11:27:40 [DEBUG   ] Got command RPT from MCS: ref #12611
2013-06-19 11:27:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 11:27:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12611  98 56462 41260774 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 11:27:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 11:28:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 11:28:25 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 11:28:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714520
2013-06-19 11:28:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714198
2013-06-19 11:28:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714452
2013-06-19 11:28:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713747
2013-06-19 11:28:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714259
2013-06-19 11:28:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546043
2013-06-19 11:28:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546036
2013-06-19 11:28:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546175
2013-06-19 11:28:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546206
2013-06-19 11:28:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546053
2013-06-19 11:28:32 [DEBUG   ] Finished updating board flags in 1.611 seconds
2013-06-19 11:28:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 11:29:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 11:29:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 11:29:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714520
2013-06-19 11:29:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714198
2013-06-19 11:29:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714452
2013-06-19 11:29:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713747
2013-06-19 11:29:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714259
2013-06-19 11:29:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192546043
2013-06-19 11:29:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192546036
2013-06-19 11:29:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192546175
2013-06-19 11:29:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546206
2013-06-19 11:29:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192546053
2013-06-19 11:29:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2013-06-19 11:29:32 [DEBUG   ] Finished updating board flags in 1.609 seconds
2013-06-19 11:29:45 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 11:30:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 11:30:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-19 11:30:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-19 11:30:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 11:30:32 [DEBUG   ] Finished updating board flags in 1.597 seconds
2013-06-19 11:30:45 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2013-06-19 11:31:05 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 11:31:26 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-19 11:31:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-19 11:31:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-19 11:31:32 [DEBUG   ] Finished updating board flags in 1.416 seconds
2013-06-19 11:31:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 11:32:06 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 11:32:26 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 11:32:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:32:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:32:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:32:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:32:31 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:32:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:32:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:32:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:32:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:32:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:32:32 [DEBUG   ] Finished updating board flags in 1.380 seconds
2013-06-19 11:32:40 [DEBUG   ] Got command RPT from MCS: ref #12627
2013-06-19 11:32:40 [DEBUG   ] summary = ERROR
2013-06-19 11:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12627  13 56462 41560769 A  ERRORERROR'
2013-06-19 11:32:40 [DEBUG   ] Got command RPT from MCS: ref #12628
2013-06-19 11:32:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 11:32:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12628  98 56462 41560770 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 11:32:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 11:33:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 11:33:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 11:33:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:33:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:33:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:33:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:33:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:33:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:33:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:33:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:33:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:33:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:33:33 [DEBUG   ] Finished updating board flags in 2.218 seconds
2013-06-19 11:33:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 11:34:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 11:34:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 11:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:34:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:34:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:34:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:34:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:34:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:34:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:34:33 [DEBUG   ] Finished updating board flags in 2.228 seconds
2013-06-19 11:34:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 11:35:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 11:35:26 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2013-06-19 11:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:35:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:35:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:35:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:35:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:35:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:35:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:35:33 [DEBUG   ] Finished updating board flags in 2.156 seconds
2013-06-19 11:35:46 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2013-06-19 11:36:06 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2013-06-19 11:36:27 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2013-06-19 11:36:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:36:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:36:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:36:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:36:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:36:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:36:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:36:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:36:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:36:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:36:33 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 11:36:34 [DEBUG   ] Finished updating board flags in 2.410 seconds
2013-06-19 11:36:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 11:37:07 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 11:37:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 11:37:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:37:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:37:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:37:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:37:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:37:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:37:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:37:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:37:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:37:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:37:33 [DEBUG   ] Finished updating board flags in 1.999 seconds
2013-06-19 11:37:40 [DEBUG   ] Got command RPT from MCS: ref #12644
2013-06-19 11:37:40 [DEBUG   ] summary = ERROR
2013-06-19 11:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12644  13 56462 41860766 A  ERRORERROR'
2013-06-19 11:37:40 [DEBUG   ] Got command RPT from MCS: ref #12645
2013-06-19 11:37:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 11:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12645  98 56462 41860766 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 11:37:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 11:38:07 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 11:38:27 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 11:38:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:38:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:38:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:38:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:38:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:38:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:38:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:38:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:38:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:38:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:38:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 11:38:33 [DEBUG   ] Finished updating board flags in 1.840 seconds
2013-06-19 11:38:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 11:39:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 11:39:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 11:39:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:39:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:39:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:39:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:39:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:39:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:39:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:39:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:39:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:39:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:39:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 11:39:33 [DEBUG   ] Finished updating board flags in 1.764 seconds
2013-06-19 11:39:47 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 11:40:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 11:40:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 11:40:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:40:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:40:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:40:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:40:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:40:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:40:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:40:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:40:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:40:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:40:33 [DEBUG   ] Finished updating board flags in 1.617 seconds
2013-06-19 11:40:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 11:41:07 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 11:41:28 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-19 11:41:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:41:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:41:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:41:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:41:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:41:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:41:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:41:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:41:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:41:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:41:33 [DEBUG   ] Finished updating board flags in 1.595 seconds
2013-06-19 11:41:48 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 11:42:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 11:42:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 11:42:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:42:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:42:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:42:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:42:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:42:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:42:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:42:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:42:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:42:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:42:33 [DEBUG   ] Finished updating board flags in 1.410 seconds
2013-06-19 11:42:40 [DEBUG   ] Got command RPT from MCS: ref #12661
2013-06-19 11:42:40 [DEBUG   ] summary = ERROR
2013-06-19 11:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12661  13 56462 42160765 A  ERRORERROR'
2013-06-19 11:42:40 [DEBUG   ] Got command RPT from MCS: ref #12662
2013-06-19 11:42:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 11:42:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12662  98 56462 42160766 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 11:42:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 11:43:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 11:43:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 11:43:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:43:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:43:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:43:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:43:32 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:43:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:43:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:43:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:43:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:43:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:43:33 [DEBUG   ] Finished updating board flags in 1.475 seconds
2013-06-19 11:43:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 11:44:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 11:44:28 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 11:44:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:44:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:44:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:44:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:44:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:44:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:44:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 11:44:34 [DEBUG   ] Finished updating board flags in 2.398 seconds
2013-06-19 11:44:48 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 11:45:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 11:45:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 11:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:45:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:45:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:45:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-06-19 11:45:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 11:45:34 [CRITICAL] MGT underflow detected on beam(s) 1, 4, 2, 3
2013-06-19 11:45:34 [DEBUG   ] Finished updating board flags in 2.121 seconds
2013-06-19 11:45:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 11:46:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 11:46:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 11:46:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:46:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:46:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:46:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:46:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:46:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:46:34 [DEBUG   ] Finished updating board flags in 2.023 seconds
2013-06-19 11:46:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 11:47:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 11:47:28 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 11:47:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:47:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:47:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:47:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:47:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:47:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:47:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:47:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:47:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:47:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:47:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 11:47:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2013-06-19 11:47:34 [CRITICAL] MGT underflow detected on beam(s) 1, 4, 2, 3
2013-06-19 11:47:34 [DEBUG   ] Finished updating board flags in 1.985 seconds
2013-06-19 11:47:40 [DEBUG   ] Got command RPT from MCS: ref #12678
2013-06-19 11:47:40 [DEBUG   ] summary = ERROR
2013-06-19 11:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12678  13 56462 42460769 A  ERRORERROR'
2013-06-19 11:47:40 [DEBUG   ] Got command RPT from MCS: ref #12679
2013-06-19 11:47:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 11:47:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12679  98 56462 42460770 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 11:47:48 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 11:48:09 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2013-06-19 11:48:29 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 11:48:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:48:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:48:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:48:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:48:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:48:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-19 11:48:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:48:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:48:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:48:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:48:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:48:34 [DEBUG   ] Finished updating board flags in 1.808 seconds
2013-06-19 11:48:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 11:49:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 11:49:29 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 11:49:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:49:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:49:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:49:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:49:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:49:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:49:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:49:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:49:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:49:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:49:34 [DEBUG   ] Finished updating board flags in 1.807 seconds
2013-06-19 11:49:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 11:50:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 11:50:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 11:50:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:50:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:50:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:50:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:50:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:50:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:50:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:50:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:50:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:50:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:50:34 [DEBUG   ] Finished updating board flags in 1.778 seconds
2013-06-19 11:50:49 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 11:51:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 11:51:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 11:51:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:51:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:51:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:51:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:51:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:51:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:51:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:51:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:51:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:51:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:51:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 11:51:34 [DEBUG   ] Finished updating board flags in 1.614 seconds
2013-06-19 11:51:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 11:52:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 11:52:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 11:52:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:52:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:52:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:52:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:52:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:52:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:52:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:52:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:52:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:52:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:52:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 11:52:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 3
2013-06-19 11:52:34 [DEBUG   ] Finished updating board flags in 1.637 seconds
2013-06-19 11:52:40 [DEBUG   ] Got command RPT from MCS: ref #12695
2013-06-19 11:52:40 [DEBUG   ] summary = ERROR
2013-06-19 11:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12695  13 56462 42760773 A  ERRORERROR'
2013-06-19 11:52:40 [DEBUG   ] Got command RPT from MCS: ref #12696
2013-06-19 11:52:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 11:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12696  98 56462 42760774 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 11:52:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 11:53:09 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 11:53:29 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 11:53:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:53:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:53:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:53:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:53:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:53:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:53:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:53:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:53:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:53:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:53:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 11:53:34 [DEBUG   ] Finished updating board flags in 1.557 seconds
2013-06-19 11:53:49 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 11:54:09 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 11:54:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 11:54:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:54:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:54:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:54:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:54:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:54:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:54:34 [DEBUG   ] Finished updating board flags in 1.422 seconds
2013-06-19 11:54:49 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 11:55:09 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 11:55:30 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-19 11:55:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:55:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:55:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:55:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:55:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:55:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:55:34 [DEBUG   ] Finished updating board flags in 1.409 seconds
2013-06-19 11:55:50 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2013-06-19 11:56:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 11:56:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 11:56:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:56:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:56:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:56:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:56:33 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:56:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:56:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 11:56:34 [DEBUG   ] Finished updating board flags in 1.372 seconds
2013-06-19 11:56:50 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 11:57:10 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2013-06-19 11:57:30 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 11:57:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:57:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:57:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:57:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:57:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:57:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:57:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:57:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:57:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:57:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:57:35 [DEBUG   ] Finished updating board flags in 2.214 seconds
2013-06-19 11:57:40 [DEBUG   ] Got command RPT from MCS: ref #12712
2013-06-19 11:57:40 [DEBUG   ] summary = ERROR
2013-06-19 11:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12712  13 56462 43060769 A  ERRORERROR'
2013-06-19 11:57:40 [DEBUG   ] Got command RPT from MCS: ref #12713
2013-06-19 11:57:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 11:57:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12713  98 56462 43060770 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 11:57:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 11:58:10 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 11:58:30 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 11:58:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:58:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:58:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:58:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:58:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:58:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:58:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:58:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:58:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:58:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:58:35 [DEBUG   ] Finished updating board flags in 2.191 seconds
2013-06-19 11:58:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 11:59:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 11:59:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 11:59:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 11:59:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 11:59:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 11:59:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 11:59:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 11:59:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 11:59:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 11:59:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 11:59:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 11:59:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 11:59:35 [DEBUG   ] Finished updating board flags in 2.019 seconds
2013-06-19 11:59:50 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 12:00:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 12:00:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 12:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 12:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 12:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 12:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 12:00:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 12:00:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 12:00:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 12:00:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 12:00:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 12:00:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 12:00:35 [DEBUG   ] Finished updating board flags in 1.993 seconds
2013-06-19 12:00:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 12:01:10 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 12:01:31 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2013-06-19 12:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 12:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 12:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 12:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 12:01:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 12:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 12:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 12:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 12:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 12:01:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 12:01:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 12:01:35 [DEBUG   ] Finished updating board flags in 1.801 seconds
2013-06-19 12:01:51 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 12:02:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 12:02:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 12:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 12:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 12:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 12:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 12:02:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 12:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 12:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 12:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 12:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 12:02:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 12:02:35 [DEBUG   ] Finished updating board flags in 1.807 seconds
2013-06-19 12:02:40 [DEBUG   ] Got command RPT from MCS: ref #12729
2013-06-19 12:02:40 [DEBUG   ] summary = ERROR
2013-06-19 12:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12729  13 56462 43360781 A  ERRORERROR'
2013-06-19 12:02:40 [DEBUG   ] Got command RPT from MCS: ref #12730
2013-06-19 12:02:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 12:02:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12730  98 56462 43360782 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 12:02:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 12:03:11 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 12:03:31 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 12:03:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714324
2013-06-19 12:03:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192714002
2013-06-19 12:03:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714256
2013-06-19 12:03:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713551
2013-06-19 12:03:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192714063
2013-06-19 12:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545847
2013-06-19 12:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545840
2013-06-19 12:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545979
2013-06-19 12:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192546010
2013-06-19 12:03:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545857
2013-06-19 12:03:35 [DEBUG   ] Finished updating board flags in 1.831 seconds
2013-06-19 12:03:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 12:04:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 12:04:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714128
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192713806
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714060
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713355
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192713867
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999979
2013-06-19 12:04:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545651
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545644
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545783
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192545814
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545661
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999979
2013-06-19 12:04:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999979
2013-06-19 12:04:35 [DEBUG   ] Finished updating board flags in 1.831 seconds
2013-06-19 12:04:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 12:05:11 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 12:05:31 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714128
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192713806
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714060
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713355
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192713867
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 1 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 2 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 3 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 4 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa27, chip 5 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 1 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 2 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 3 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 4 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa24, chip 5 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 1 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 2 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 3 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 4 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa23, chip 5 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 1 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 2 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 3 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 4 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa18, chip 5 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 1 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 2 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 3 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 4 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa10, chip 5 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 1 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 2 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 3 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 4 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa32, chip 5 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 1 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 2 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 3 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 4 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa11, chip 5 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 1 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 2 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 3 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 4 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa30, chip 5 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 1 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 2 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 3 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 4 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa12, chip 5 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 1 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 2 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 3 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 4 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa8, chip 5 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 1 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 2 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 3 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 4 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa13, chip 5 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 1 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 2 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 3 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 4 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa26, chip 5 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 1 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 2 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 3 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 4 with 195999999
2013-06-19 12:05:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa14, chip 5 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545651
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545644
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545783
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192545814
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545661
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 1 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 2 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 3 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 4 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa22, chip 5 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 1 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 2 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 3 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 4 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa20, chip 5 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 1 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 2 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 3 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 4 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa1, chip 5 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 1 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 2 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 3 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 4 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa5, chip 5 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 1 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 2 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 3 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 4 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa25, chip 5 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 1 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 2 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 3 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 4 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa35, chip 5 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 1 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 2 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 3 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 4 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa19, chip 5 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 1 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 2 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 3 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 4 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa21, chip 5 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 1 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 2 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 3 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 4 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa6, chip 5 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 1 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 2 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 3 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 4 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa7, chip 5 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 1 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 2 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 3 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 4 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa33, chip 5 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 1 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 2 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 3 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 4 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa15, chip 5 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 1 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 2 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 3 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 4 with 195999999
2013-06-19 12:05:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa28, chip 5 with 195999999
2013-06-19 12:05:35 [DEBUG   ] Finished updating board flags in 1.753 seconds
2013-06-19 12:05:52 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 12:06:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 12:06:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2013-06-19 12:06:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714128
2013-06-19 12:06:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192713806
2013-06-19 12:06:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714060
2013-06-19 12:06:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713355
2013-06-19 12:06:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192713867
2013-06-19 12:06:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-19 12:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545651
2013-06-19 12:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545644
2013-06-19 12:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545783
2013-06-19 12:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192545814
2013-06-19 12:06:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545661
2013-06-19 12:06:35 [DEBUG   ] Finished updating board flags in 1.592 seconds
2013-06-19 12:06:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2013-06-19 12:07:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 12:07:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 12:07:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714128
2013-06-19 12:07:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192713806
2013-06-19 12:07:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714060
2013-06-19 12:07:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713355
2013-06-19 12:07:34 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192713867
2013-06-19 12:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545651
2013-06-19 12:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545644
2013-06-19 12:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545783
2013-06-19 12:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192545814
2013-06-19 12:07:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545661
2013-06-19 12:07:35 [DEBUG   ] Finished updating board flags in 1.393 seconds
2013-06-19 12:07:40 [DEBUG   ] Got command RPT from MCS: ref #12746
2013-06-19 12:07:40 [DEBUG   ] summary = ERROR
2013-06-19 12:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12746  13 56462 43660777 A  ERRORERROR'
2013-06-19 12:07:40 [DEBUG   ] Got command RPT from MCS: ref #12747
2013-06-19 12:07:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 12:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12747  98 56462 43660778 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 12:07:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 12:08:12 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 12:08:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 12:08:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714128
2013-06-19 12:08:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192713806
2013-06-19 12:08:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714060
2013-06-19 12:08:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713355
2013-06-19 12:08:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192713867
2013-06-19 12:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545651
2013-06-19 12:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545644
2013-06-19 12:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545783
2013-06-19 12:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192545814
2013-06-19 12:08:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545661
2013-06-19 12:08:36 [DEBUG   ] Finished updating board flags in 2.252 seconds
2013-06-19 12:08:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 12:09:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 12:09:32 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 12:09:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714128
2013-06-19 12:09:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192713806
2013-06-19 12:09:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714060
2013-06-19 12:09:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713355
2013-06-19 12:09:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192713867
2013-06-19 12:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545651
2013-06-19 12:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545644
2013-06-19 12:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545783
2013-06-19 12:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192545814
2013-06-19 12:09:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545661
2013-06-19 12:09:36 [DEBUG   ] Finished updating board flags in 2.148 seconds
2013-06-19 12:09:52 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2013-06-19 12:10:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 12:10:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 12:10:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714128
2013-06-19 12:10:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192713806
2013-06-19 12:10:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714060
2013-06-19 12:10:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713355
2013-06-19 12:10:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192713867
2013-06-19 12:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545651
2013-06-19 12:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545644
2013-06-19 12:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545783
2013-06-19 12:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192545814
2013-06-19 12:10:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545661
2013-06-19 12:10:36 [DEBUG   ] Finished updating board flags in 2.015 seconds
2013-06-19 12:10:52 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 12:11:12 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 12:11:33 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-19 12:11:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714128
2013-06-19 12:11:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192713806
2013-06-19 12:11:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714060
2013-06-19 12:11:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713355
2013-06-19 12:11:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192713867
2013-06-19 12:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545651
2013-06-19 12:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545644
2013-06-19 12:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545783
2013-06-19 12:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192545814
2013-06-19 12:11:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545661
2013-06-19 12:11:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 12:11:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 12:11:36 [DEBUG   ] Finished updating board flags in 1.997 seconds
2013-06-19 12:11:53 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 12:12:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 12:12:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2013-06-19 12:12:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714128
2013-06-19 12:12:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192713806
2013-06-19 12:12:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714060
2013-06-19 12:12:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713355
2013-06-19 12:12:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192713867
2013-06-19 12:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545651
2013-06-19 12:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545644
2013-06-19 12:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545783
2013-06-19 12:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192545814
2013-06-19 12:12:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545661
2013-06-19 12:12:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 12:12:36 [DEBUG   ] Finished updating board flags in 1.808 seconds
2013-06-19 12:12:40 [DEBUG   ] Got command RPT from MCS: ref #12763
2013-06-19 12:12:40 [DEBUG   ] summary = ERROR
2013-06-19 12:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12763  13 56462 43960781 A  ERRORERROR'
2013-06-19 12:12:40 [DEBUG   ] Got command RPT from MCS: ref #12764
2013-06-19 12:12:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 12:12:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12764  98 56462 43960782 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 12:12:53 [DEBUG   ] Finished updating ant stats in 1.180 seconds
2013-06-19 12:13:13 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2013-06-19 12:13:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 12:13:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714128
2013-06-19 12:13:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192713806
2013-06-19 12:13:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714060
2013-06-19 12:13:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713355
2013-06-19 12:13:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192713867
2013-06-19 12:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545651
2013-06-19 12:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545644
2013-06-19 12:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545783
2013-06-19 12:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192545814
2013-06-19 12:13:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545661
2013-06-19 12:13:36 [DEBUG   ] Finished updating board flags in 1.786 seconds
2013-06-19 12:13:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2013-06-19 12:14:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 12:14:33 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 12:14:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714128
2013-06-19 12:14:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192713806
2013-06-19 12:14:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714060
2013-06-19 12:14:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713355
2013-06-19 12:14:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192713867
2013-06-19 12:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545651
2013-06-19 12:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545644
2013-06-19 12:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545783
2013-06-19 12:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192545814
2013-06-19 12:14:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545661
2013-06-19 12:14:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 12:14:36 [DEBUG   ] Finished updating board flags in 1.620 seconds
2013-06-19 12:14:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 12:15:14 [DEBUG   ] Finished updating ant stats in 1.604 seconds
2013-06-19 12:15:33 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 12:15:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714128
2013-06-19 12:15:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192713806
2013-06-19 12:15:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714060
2013-06-19 12:15:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713355
2013-06-19 12:15:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192713867
2013-06-19 12:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545651
2013-06-19 12:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545644
2013-06-19 12:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545783
2013-06-19 12:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192545814
2013-06-19 12:15:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545661
2013-06-19 12:15:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 12:15:36 [DEBUG   ] Finished updating board flags in 1.574 seconds
2013-06-19 12:15:53 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 12:16:13 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2013-06-19 12:16:34 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2013-06-19 12:16:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714128
2013-06-19 12:16:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192713806
2013-06-19 12:16:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714060
2013-06-19 12:16:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713355
2013-06-19 12:16:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192713867
2013-06-19 12:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545651
2013-06-19 12:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545644
2013-06-19 12:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545783
2013-06-19 12:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192545814
2013-06-19 12:16:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545661
2013-06-19 12:16:36 [DEBUG   ] Finished updating board flags in 1.419 seconds
2013-06-19 12:16:54 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 12:17:14 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 12:17:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 12:17:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714128
2013-06-19 12:17:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192713806
2013-06-19 12:17:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714060
2013-06-19 12:17:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713355
2013-06-19 12:17:35 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192713867
2013-06-19 12:17:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 2
2013-06-19 12:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545651
2013-06-19 12:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545644
2013-06-19 12:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545783
2013-06-19 12:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192545814
2013-06-19 12:17:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545661
2013-06-19 12:17:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 12:17:36 [DEBUG   ] Finished updating board flags in 1.393 seconds
2013-06-19 12:17:40 [DEBUG   ] Got command RPT from MCS: ref #12780
2013-06-19 12:17:40 [DEBUG   ] summary = ERROR
2013-06-19 12:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12780  13 56462 44260781 A  ERRORERROR'
2013-06-19 12:17:40 [DEBUG   ] Got command RPT from MCS: ref #12781
2013-06-19 12:17:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 12:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12781  98 56462 44260782 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 12:17:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 12:18:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 12:18:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 12:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714128
2013-06-19 12:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192713806
2013-06-19 12:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714060
2013-06-19 12:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713355
2013-06-19 12:18:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192713867
2013-06-19 12:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545651
2013-06-19 12:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545644
2013-06-19 12:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545783
2013-06-19 12:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192545814
2013-06-19 12:18:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545661
2013-06-19 12:18:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 12:18:37 [DEBUG   ] Finished updating board flags in 2.293 seconds
2013-06-19 12:18:54 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 12:19:14 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2013-06-19 12:19:34 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2013-06-19 12:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714128
2013-06-19 12:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192713806
2013-06-19 12:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714060
2013-06-19 12:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713355
2013-06-19 12:19:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192713867
2013-06-19 12:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545651
2013-06-19 12:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545644
2013-06-19 12:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545783
2013-06-19 12:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192545814
2013-06-19 12:19:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545661
2013-06-19 12:19:37 [DEBUG   ] Finished updating board flags in 2.116 seconds
2013-06-19 12:19:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 12:20:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 12:20:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 12:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714128
2013-06-19 12:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192713806
2013-06-19 12:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714060
2013-06-19 12:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713355
2013-06-19 12:20:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192713867
2013-06-19 12:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545651
2013-06-19 12:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545644
2013-06-19 12:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545783
2013-06-19 12:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192545814
2013-06-19 12:20:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545661
2013-06-19 12:20:37 [DEBUG   ] Finished updating board flags in 2.002 seconds
2013-06-19 12:20:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 12:21:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 12:21:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2013-06-19 12:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714128
2013-06-19 12:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192713806
2013-06-19 12:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714060
2013-06-19 12:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713355
2013-06-19 12:21:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192713867
2013-06-19 12:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545651
2013-06-19 12:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545644
2013-06-19 12:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545783
2013-06-19 12:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192545814
2013-06-19 12:21:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545661
2013-06-19 12:21:37 [DEBUG   ] Finished updating board flags in 2.009 seconds
2013-06-19 12:21:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2013-06-19 12:22:14 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2013-06-19 12:22:35 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2013-06-19 12:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714128
2013-06-19 12:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192713806
2013-06-19 12:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714060
2013-06-19 12:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713355
2013-06-19 12:22:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192713867
2013-06-19 12:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545651
2013-06-19 12:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545644
2013-06-19 12:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545783
2013-06-19 12:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192545814
2013-06-19 12:22:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545661
2013-06-19 12:22:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 12:22:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2013-06-19 12:22:37 [DEBUG   ] Finished updating board flags in 1.987 seconds
2013-06-19 12:22:40 [DEBUG   ] Got command RPT from MCS: ref #12797
2013-06-19 12:22:40 [DEBUG   ] summary = ERROR
2013-06-19 12:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12797  13 56462 44560781 A  ERRORERROR'
2013-06-19 12:22:40 [DEBUG   ] Got command RPT from MCS: ref #12798
2013-06-19 12:22:40 [DEBUG   ] info = T_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2013-06-19 12:22:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT    12798  98 56462 44560782 A  ERRORT_NOM1 T_NOM4 T_NOM2 T_NOM3! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2013-06-19 12:22:55 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2013-06-19 12:23:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2013-06-19 12:23:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2013-06-19 12:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714128
2013-06-19 12:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192713806
2013-06-19 12:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714060
2013-06-19 12:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713355
2013-06-19 12:23:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192713867
2013-06-19 12:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545651
2013-06-19 12:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545644
2013-06-19 12:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545783
2013-06-19 12:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192545814
2013-06-19 12:23:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545661
2013-06-19 12:23:37 [DEBUG   ] Finished updating board flags in 1.819 seconds
2013-06-19 12:23:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 12:24:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2013-06-19 12:24:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2013-06-19 12:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 1 with 192714128
2013-06-19 12:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 2 with 192713806
2013-06-19 12:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 3 with 192714060
2013-06-19 12:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 4 with 192713355
2013-06-19 12:24:36 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa16, chip 5 with 192713867
2013-06-19 12:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 1 with 192545651
2013-06-19 12:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 2 with 192545644
2013-06-19 12:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 3 with 192545783
2013-06-19 12:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 4 with 192545814
2013-06-19 12:24:37 [WARNING ] MonitorFlags: 1PPS unstable on hostname lwa34, chip 5 with 192545661
2013-06-19 12:24:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 1
2013-06-19 12:24:37 [DEBUG   ] Finished updating board flags in 1.785 seconds
2013-06-19 12:24:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
